-- Logs begin at Thu 2022-08-18 15:53:06 UTC, end at Thu 2022-08-18 17:32:08 UTC. -- Aug 18 16:49:48.302039 dv-cinder-853678-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 16:49:48.309410 dv-cinder-853678-2-smb devstack@keystone.service[81504]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 16:49:48.311400 dv-cinder-853678-2-smb devstack@keystone.service[81504]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 16:49:48 2022] *** Aug 18 16:49:48.311400 dv-cinder-853678-2-smb devstack@keystone.service[81504]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 16:49:48.311400 dv-cinder-853678-2-smb devstack@keystone.service[81504]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 16:49:48.311400 dv-cinder-853678-2-smb devstack@keystone.service[81504]: nodename: dv-cinder-853678-2-smb Aug 18 16:49:48.311400 dv-cinder-853678-2-smb devstack@keystone.service[81504]: machine: x86_64 Aug 18 16:49:48.311400 dv-cinder-853678-2-smb devstack@keystone.service[81504]: clock source: unix Aug 18 16:49:48.311400 dv-cinder-853678-2-smb devstack@keystone.service[81504]: pcre jit disabled Aug 18 16:49:48.311859 dv-cinder-853678-2-smb devstack@keystone.service[81504]: detected number of CPU cores: 4 Aug 18 16:49:48.311859 dv-cinder-853678-2-smb devstack@keystone.service[81504]: current working directory: / Aug 18 16:49:48.311859 dv-cinder-853678-2-smb devstack@keystone.service[81504]: detected binary path: /usr/bin/uwsgi-core Aug 18 16:49:48.311859 dv-cinder-853678-2-smb devstack@keystone.service[81504]: your processes number limit is 47680 Aug 18 16:49:48.311859 dv-cinder-853678-2-smb devstack@keystone.service[81504]: your memory page size is 4096 bytes Aug 18 16:49:48.311859 dv-cinder-853678-2-smb devstack@keystone.service[81504]: detected max file descriptor number: 2048 Aug 18 16:49:48.311859 dv-cinder-853678-2-smb devstack@keystone.service[81504]: lock engine: pthread robust mutexes Aug 18 16:49:48.311859 dv-cinder-853678-2-smb devstack@keystone.service[81504]: thunder lock: enabled Aug 18 16:49:48.311859 dv-cinder-853678-2-smb devstack@keystone.service[81504]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 16:49:48.311859 dv-cinder-853678-2-smb devstack@keystone.service[81504]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 16:49:48.351836 dv-cinder-853678-2-smb devstack@keystone.service[81504]: Python main interpreter initialized at 0x557c6f5579c0 Aug 18 16:49:48.351836 dv-cinder-853678-2-smb devstack@keystone.service[81504]: python threads support enabled Aug 18 16:49:48.351836 dv-cinder-853678-2-smb devstack@keystone.service[81504]: your server socket listen backlog is limited to 100 connections Aug 18 16:49:48.351836 dv-cinder-853678-2-smb devstack@keystone.service[81504]: your mercy for graceful operations on workers is 90 seconds Aug 18 16:49:48.352225 dv-cinder-853678-2-smb devstack@keystone.service[81504]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 16:49:48.352307 dv-cinder-853678-2-smb devstack@keystone.service[81504]: *** Operational MODE: preforking *** Aug 18 16:49:48.352594 dv-cinder-853678-2-smb devstack@keystone.service[81504]: *** uWSGI is running in multiple interpreter mode *** Aug 18 16:49:48.352594 dv-cinder-853678-2-smb devstack@keystone.service[81504]: spawned uWSGI master process (pid: 81504) Aug 18 16:49:48.352801 dv-cinder-853678-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 18 16:49:48.355085 dv-cinder-853678-2-smb devstack@keystone.service[81504]: spawned uWSGI worker 1 (pid: 81514, cores: 1) Aug 18 16:49:48.355085 dv-cinder-853678-2-smb devstack@keystone.service[81504]: spawned uWSGI worker 2 (pid: 81515, cores: 1) Aug 18 16:49:48.355085 dv-cinder-853678-2-smb devstack@keystone.service[81504]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 16:49:52.637099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:49:52.637099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: from cryptography.utils import int_from_bytes Aug 18 16:49:52.637922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:49:52.637922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: from cryptography.utils import int_from_bytes Aug 18 16:49:52.641755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:49:52.641755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: from cryptography.utils import int_from_bytes Aug 18 16:49:52.642208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:49:52.642208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: from cryptography.utils import int_from_bytes Aug 18 16:49:52.687024 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 16:49:52.687185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 16:49:52.687383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] command line args: [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 16:49:52.687652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 16:49:52.687827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ================================================================================ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 16:49:52.688081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] admin_token = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.688327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config_dir = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.688541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.688725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] config_source = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.688902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] debug = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.689095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.689597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.689693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 16:49:52.689758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.689823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 16:49:52.689888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.689948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] command line args: [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 16:49:52.690116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.690231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 16:49:52.690333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ================================================================================ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 16:49:52.690434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.690534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_config_append = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.690634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] admin_token = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.690739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.690846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config_dir = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.690945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_dir = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.691537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.691632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.691731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] config_source = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.691838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.691924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] debug = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.692046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.692122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.692261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.692346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.692424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.692531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.692613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.692691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.692772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.692892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.693008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.693089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.693241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.693376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_config_append = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.693460 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.693526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.693589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_dir = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.693688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.693859 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.693975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.694122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.694199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.694320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.694402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.694547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.694702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.694837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.694961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.695091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.695091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.695316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.695391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.695517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.695595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] publish_errors = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.695709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.695829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.695951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.696087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.696221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.696303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.696387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.696493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.696583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.696657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.696815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] standard_threads = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.696893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.697046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.697129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.697286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.697461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.697629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.697721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_journal = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.697800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_json = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.697870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] publish_errors = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.697946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_stderr = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.698018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.698120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] use_syslog = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.698253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.698331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.698431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.698586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.698670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.698809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.698884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.699068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.699149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] standard_threads = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.699307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.699394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.699554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.699633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.699728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.699809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.699903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_journal = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.700022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.700107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_json = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.700239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_stderr = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.700315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.700414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] use_syslog = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.700511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.700670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:49:52.700763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.700929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.701007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.701169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.701252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.701430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.701519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.701661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.701739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.701909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.701995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.702142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.702227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.702373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.702451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.702618 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.702695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.702867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.702951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.703109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.703186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.703340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.703419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.703577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.703661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.703825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.703910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.704061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.704139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.704289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.704362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.704543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.704626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.704773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.704861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.705003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.705088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.705236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.705314 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.705482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.705559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.705727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.705805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.705955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.706032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.706183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.706260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.706427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.706506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.707220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.707308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.707455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.707533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.707691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.707768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.707918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.707994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.708152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.708235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.708385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.708477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.708641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.708719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.708872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.708951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.709102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.709181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.709331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.709408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.709566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.709644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.709812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.709889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.710037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.710120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.710272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.710349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.710495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.710580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.710721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.710799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.710952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.711028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.711185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.711264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.711415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.711491 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.711647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.711723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.711879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.711962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.712114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.712191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.712345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.712420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.712603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.712683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.712834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.712911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.713068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.713152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.713303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.713380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.713674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.713834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.713942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.714047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.714047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.714245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.714341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.714436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.714537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.714617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.714733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.714847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.714923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.715044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.715121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.715247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.715352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.715484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.715591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.715670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.715833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.715921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.716067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.716205 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.716345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.716488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.716633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.716768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.716889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.717018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.717139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.717261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.717383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.717507 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.717627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.717757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.717842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.717964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.718041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.718114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.718228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.718313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.718387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.718501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.718577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.718649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.718791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.718881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.719032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.719110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.719270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.719344 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.719504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.719626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.719744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.719855 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.719979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.720085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.720216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.720333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.720468 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.720575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.720703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.720817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.720922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.721029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.721150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.721255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.721383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.721500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.721639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.721815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.721914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.722015 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.722110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.722251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.722366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.722479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.722588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.722685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.722786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.722888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.723035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.723151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.723257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.723360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.723489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.external = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.723597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.723702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.723807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.723942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.724083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.724197 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.724301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.724403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.724565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.password = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.724680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.724808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] auth.token = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.724887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.724959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.725117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.725224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.725363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.725444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.725591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.725671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.725838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.725918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.external = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.726070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.726147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.726299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.726378 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.726532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.726612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.726776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.726846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.password = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.727022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.727103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] auth.token = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.727258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.727335 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.727493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.727571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.727734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.727813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.727964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.728042 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.728211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.728288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.728475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.728557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.728708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.728787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.728948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.729027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.729198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.729278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.729451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.729538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.729703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.729782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.729939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.730019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.730181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.730259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.730417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.730494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.730651 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.730732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.730895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.730975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.731140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.731220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.731369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.731450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.731614 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.731694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.731847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.731934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.732100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.732180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.732335 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.732414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.732626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.732719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.732864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.732943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.733101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.733180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.733332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.733418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.733581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.733660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.733812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.733890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.734048 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.734134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.734283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.736747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.736892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.737010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.737112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.737220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.737320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.737418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.737515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.737620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.737620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.738382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.738490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.738595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.738692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.738787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.738883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.738988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.739086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.739702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.739826 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.739926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740847 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.740944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.741173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.741546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.741627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.741691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.741809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.741886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.741949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.742972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.743996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.744093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.744188 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.744289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.744386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.744588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.744669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.744732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.744793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.744865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.744937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745012 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745742 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.745969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746188 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.746941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.747052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.747197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.747324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.747443 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.747533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.747676 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.747757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.747906 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.748043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.748142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.748231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.748376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.748476 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.748638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.748718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.748867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.748961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.749114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.749193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.749358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.749437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.749601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.749689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.749845 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.749925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.750089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.750168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.750318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.750405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.750561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.750639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.750792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.750871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.751026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.751113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.751260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.751338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.751490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.751568 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.751720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.751809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.751963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.752051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.752196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.752275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.752443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.752612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.752689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.752762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.752922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.753002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.753157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.753253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.753386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.753467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.754201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.754291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.754446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.754539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.754685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.754764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.754929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.755069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.755147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.755230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.755380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.755460 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.755623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.755701 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.755868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.755954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.756102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.756182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.756346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.756425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.756617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.756709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.756851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.756931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.757086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.757164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.757326 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.757418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.757564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.757643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.757795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.757879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.758033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.758114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.758260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.758338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.758505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.758584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.758750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.758831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.758983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.759062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.759225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.759303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.759474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.759557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.759707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.759785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.759949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.760028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.760184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.760264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.760415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.760536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.760673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.760753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.760916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.760995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.761144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.761222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.761391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.761469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.761637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.761831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.761943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.762040 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.762137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.762295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.762412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.762545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.762625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.762792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.762871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.763039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.763128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.763271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.763353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.763519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.763597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.763766 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.763855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.764001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.764081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.764231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.764310 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.764480 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.764700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.764781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.764942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.765021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.765194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.765288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.765439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.765518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.765673 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.765753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.765905 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.765993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.766133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.766213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.766365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.766445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.766599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.766687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.766846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.766925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.767078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.767157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.767312 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.767399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.767546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.767626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.767793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.767871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.768034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.768122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.768276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.768355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.768532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.768613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.768772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.768864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.769006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.769085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.769261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.769339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.769497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.769584 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.769741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.769819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.769967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.770046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.770206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.770292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.770464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.770542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.770705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.770784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.770951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.771043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.771194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.771274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.771441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.771520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.771677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.771755 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.771909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.771988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.772143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.772220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.772389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.772493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.772634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.772716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.772870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.772948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.773102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.773180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.773343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.773427 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.773575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.773655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.773821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.773910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.774055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.774137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.774297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.774377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.774525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.774604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.774762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.774845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.774994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.775081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.775156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 16:49:52.775229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.775450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.775700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.775937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.776184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.776422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.776693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.776928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.777173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.777406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.777647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.777883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:49:52.778052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 16:49:52.805992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.806227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.806424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.807790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.808025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.808253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.814938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.817482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.843236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.843462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.845263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.845439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.897516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.897984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.946463 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.946694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.948879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:52.949115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.104426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.104675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.104768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.104898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.105010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.105116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.105201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.105331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.105414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.105544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.105630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.105758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.129071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.129187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.129299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.129400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.129613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.129697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.129839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.129923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.130056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.130140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.130270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.130352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.130481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.130573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.141594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.141725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.154400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.154528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.154615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.154711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.154793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.154905 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.154993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.155119 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.155215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.155331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.155412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.155536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.155628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81514) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.155744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 16:49:53.172948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.173156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 16:49:53.173248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.173365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 16:49:53.173502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.173704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 16:49:53.173789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.173899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 16:49:53.173982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.174173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.174269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.174433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.174750 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.174947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.175029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.175211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.184939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.185056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.185220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.185336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.185495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.185598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.185783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.185869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.192785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.192889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.195671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.195766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.195956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.196041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.196240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.196324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.196550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.196639 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.196835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.196920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.197095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.197193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.197367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.197452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.197640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.197733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.198026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.198111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.198304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.198387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.198579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.198675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.220991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.221140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.222959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.223126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.223238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.223410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.227877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.228081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.228169 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.228370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.228505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.228682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.234722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.235004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.235089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.235293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.239611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.239898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.239989 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.240183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.240269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.240492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.240580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.240774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.240860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.241049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.241147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.241570 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.241661 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.241837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.241921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.242107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.258990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.259198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.259285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.259494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.263221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.263385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.266410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.266620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.266751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.266924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.271076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.271225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.274223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.274325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.277496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.277616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.277752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.277869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.278035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.278163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.278317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.278454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.278593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.278737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.278870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.279029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.295255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.295377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.295544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.295856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.295960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.296058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.296139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.296216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.303603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.304141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.305187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.305468 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.305705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.305987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.308098 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.308385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.308626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.308770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.308921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.309007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.309207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.309301 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.309512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.309790 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.320713 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.321003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.321292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.321570 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.321853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.322132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.322422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.327056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.327345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.327632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.327918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.328204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.328509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.328794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.337784 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.340855 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.343741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.344171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.345203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.346678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.346963 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.347726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.347882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.350619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.352051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.353553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.353830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.354120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.354267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.355689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.358682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.358974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.359263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.359551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.360543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.362006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.365430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.365728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.366014 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.366549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.368302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.368620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.368907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.374542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.374829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.375114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.375786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81514) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.376072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.376361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.376672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.376945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.377220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.377496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.377777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.378062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.378343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.378668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.378935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.379213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.379496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81514) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.382030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 16:49:53.382311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.382594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.382872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.383147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.383420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.383691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.383960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.384248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.384548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.384950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.385084 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.385340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.385601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 16:49:53.413983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c6f5579c0 pid: 81514 (default app) Aug 18 16:49:53.417441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8cc31-1ac3-4d68-8f80-696fe0a37162 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:49:53.417734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8cc31-1ac3-4d68-8f80-696fe0a37162 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:49:53.418005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8cc31-1ac3-4d68-8f80-696fe0a37162 None None] PATH_INFO: `/v3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:49:53.419903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c6f5579c0 pid: 81515 (default app) Aug 18 16:49:53.422516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 791 bytes} [Thu Aug 18 16:49:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:00.064787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2dfaa-f440-4ab9-955f-875462b57386 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:00.065290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2dfaa-f440-4ab9-955f-875462b57386 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:00.065290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2dfaa-f440-4ab9-955f-875462b57386 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:00.069551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1/2] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:00.075110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238efbff-d951-454f-8f84-912beec59094 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:00.075560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238efbff-d951-454f-8f84-912beec59094 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:00.075647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238efbff-d951-454f-8f84-912beec59094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:00.146830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: INFO dbcounter [None req-238efbff-d951-454f-8f84-912beec59094 None None] Registered counter for database keystone Aug 18 16:50:00.166436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG oslo_db.sqlalchemy.engines [None req-238efbff-d951-454f-8f84-912beec59094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:50:00.172688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writer thread running {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:50:00.352043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG passlib.handlers.bcrypt [None req-238efbff-d951-454f-8f84-912beec59094 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81514) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 16:50:00.352381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG passlib.handlers.bcrypt [None req-238efbff-d951-454f-8f84-912beec59094 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81514) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 16:50:00.406717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-238efbff-d951-454f-8f84-912beec59094 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:00.408323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-238efbff-d951-454f-8f84-912beec59094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:00.536732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 2/3] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 16:50:00.984494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2dfaa-f440-4ab9-955f-875462b57386 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:01.053847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: INFO dbcounter [None req-a0d2dfaa-f440-4ab9-955f-875462b57386 None None] Registered counter for database keystone Aug 18 16:50:01.075987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG oslo_db.sqlalchemy.engines [None req-a0d2dfaa-f440-4ab9-955f-875462b57386 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:50:01.082175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writer thread running {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:50:01.199541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2dfaa-f440-4ab9-955f-875462b57386 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:01.203793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c31b06-cfcf-4636-8c2e-813c29382f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:01.204422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c31b06-cfcf-4636-8c2e-813c29382f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:01.204727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c31b06-cfcf-4636-8c2e-813c29382f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:01.205001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c31b06-cfcf-4636-8c2e-813c29382f2f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:01.215346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c31b06-cfcf-4636-8c2e-813c29382f2f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:01.268340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: WARNING keystone.common.rbac_enforcer.enforcer [None req-90c31b06-cfcf-4636-8c2e-813c29382f2f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 16:50:01.268703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c31b06-cfcf-4636-8c2e-813c29382f2f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:01.278646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 2/4] 10.222.0.81 () {58 vars in 1324 bytes} [Thu Aug 18 16:50:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:50:01.284705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238efbff-d951-454f-8f84-912beec59094 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:01.299105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238efbff-d951-454f-8f84-912beec59094 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:01.304348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022ac25-d074-4c49-a235-2a6b37e558ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:01.305458 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022ac25-d074-4c49-a235-2a6b37e558ec admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:01.305741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022ac25-d074-4c49-a235-2a6b37e558ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:01.306016 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022ac25-d074-4c49-a235-2a6b37e558ec admin admin] PATH_INFO: `/v3/projects/45c851fba36042bc85eb05b39752f169` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:01.307597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022ac25-d074-4c49-a235-2a6b37e558ec admin admin] RBAC: Authorizing `identity:get_project(project_id=45c851fba36042bc85eb05b39752f169)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:01.361313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4022ac25-d074-4c49-a235-2a6b37e558ec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 16:50:01.361652 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022ac25-d074-4c49-a235-2a6b37e558ec admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:01.367167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 3/5] 10.222.0.81 () {56 vars in 1207 bytes} [Thu Aug 18 16:50:01 2022] GET /identity/v3/projects/45c851fba36042bc85eb05b39752f169 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:03.261443 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fd8c7-536a-4fe2-a137-ae4d886d6df4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:03.262019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fd8c7-536a-4fe2-a137-ae4d886d6df4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:03.262019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fd8c7-536a-4fe2-a137-ae4d886d6df4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:03.266128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 3/6] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:03.272252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107085d-546a-4688-8078-8b666121b713 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:03.272733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107085d-546a-4688-8078-8b666121b713 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:03.272826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107085d-546a-4688-8078-8b666121b713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:03.294223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3107085d-546a-4688-8078-8b666121b713 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:03.296099 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3107085d-546a-4688-8078-8b666121b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:03.304836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 4/7] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 16:50:03.569490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fd8c7-536a-4fe2-a137-ae4d886d6df4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:03.581522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fd8c7-536a-4fe2-a137-ae4d886d6df4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:03.585692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9acca-bb98-4d5e-b979-1643e447ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:03.586289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9acca-bb98-4d5e-b979-1643e447ab3b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:03.586568 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9acca-bb98-4d5e-b979-1643e447ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:03.586841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9acca-bb98-4d5e-b979-1643e447ab3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:03.594421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9acca-bb98-4d5e-b979-1643e447ab3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:03.596190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9acca-bb98-4d5e-b979-1643e447ab3b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:03.605539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 4/8] 10.222.0.81 () {58 vars in 1324 bytes} [Thu Aug 18 16:50:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:50:03.611151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107085d-546a-4688-8078-8b666121b713 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:03.621095 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107085d-546a-4688-8078-8b666121b713 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:03.625461 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85c623-8c5d-498e-87ba-db5a7aba01d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:03.626092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85c623-8c5d-498e-87ba-db5a7aba01d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:03.626379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85c623-8c5d-498e-87ba-db5a7aba01d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:03.626657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85c623-8c5d-498e-87ba-db5a7aba01d2 admin admin] PATH_INFO: `/v3/users/ea0bb7d073ca4a9588a262eed95c091c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:03.627959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85c623-8c5d-498e-87ba-db5a7aba01d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea0bb7d073ca4a9588a262eed95c091c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:03.629819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85c623-8c5d-498e-87ba-db5a7aba01d2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:03.631362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 5/9] 10.222.0.81 () {56 vars in 1198 bytes} [Thu Aug 18 16:50:03 2022] GET /identity/v3/users/ea0bb7d073ca4a9588a262eed95c091c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:05.595248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7d55a-af0e-4b7a-b59f-65ad1944a5fe None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:05.595776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7d55a-af0e-4b7a-b59f-65ad1944a5fe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:05.595880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7d55a-af0e-4b7a-b59f-65ad1944a5fe None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:05.597210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 5/10] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:05.602544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c25bf7-bedb-487b-bcf4-9c72fac3aab9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:05.603010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c25bf7-bedb-487b-bcf4-9c72fac3aab9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:05.603106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c25bf7-bedb-487b-bcf4-9c72fac3aab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:05.616508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d539881-8e9e-45d2-a1da-8c90d7cd608a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:05.616802 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d539881-8e9e-45d2-a1da-8c90d7cd608a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:05.617082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d539881-8e9e-45d2-a1da-8c90d7cd608a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:05.618416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 6/11] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:05.622340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-55c25bf7-bedb-487b-bcf4-9c72fac3aab9 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:05.623291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1fa2b-cf8f-4f88-91ef-d7b232cda3f8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:05.623544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-55c25bf7-bedb-487b-bcf4-9c72fac3aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:05.623631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1fa2b-cf8f-4f88-91ef-d7b232cda3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:05.623844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1fa2b-cf8f-4f88-91ef-d7b232cda3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:05.666388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG passlib.handlers.bcrypt [None req-04d1fa2b-cf8f-4f88-91ef-d7b232cda3f8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81515) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 16:50:05.666891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG passlib.handlers.bcrypt [None req-04d1fa2b-cf8f-4f88-91ef-d7b232cda3f8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81515) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 16:50:05.707328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 6/12] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:05.712867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-04d1fa2b-cf8f-4f88-91ef-d7b232cda3f8 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:05.714487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-04d1fa2b-cf8f-4f88-91ef-d7b232cda3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:05.824199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 7/13] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:05.977741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c25bf7-bedb-487b-bcf4-9c72fac3aab9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:06.001987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:06.083414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c25bf7-bedb-487b-bcf4-9c72fac3aab9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:06.090274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1fa2b-cf8f-4f88-91ef-d7b232cda3f8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:06.119469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d22b14-6e40-4b09-b852-73c6f9ff9017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:06.120123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d22b14-6e40-4b09-b852-73c6f9ff9017 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:06.120407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d22b14-6e40-4b09-b852-73c6f9ff9017 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:06.120739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d22b14-6e40-4b09-b852-73c6f9ff9017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:06.131752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d22b14-6e40-4b09-b852-73c6f9ff9017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-83d22b14-6e40-4b09-b852-73c6f9ff9017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:06.140421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:06.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:06.142838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 7/14] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:50:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:06.147248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d22b14-6e40-4b09-b852-73c6f9ff9017 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:06.193497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1fa2b-cf8f-4f88-91ef-d7b232cda3f8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:06.195783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:06.229466 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:06.234164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f2390-22ea-4bec-a9dd-3ed27e431376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:06.235227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f2390-22ea-4bec-a9dd-3ed27e431376 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:06.235648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f2390-22ea-4bec-a9dd-3ed27e431376 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:06.236021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f2390-22ea-4bec-a9dd-3ed27e431376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:06.249509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d22b14-6e40-4b09-b852-73c6f9ff9017 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:06.283264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2e1a6-bb58-4b13-9dfe-4bd98bd09209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:06.283871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e1a6-bb58-4b13-9dfe-4bd98bd09209 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:06.284162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e1a6-bb58-4b13-9dfe-4bd98bd09209 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:06.286252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2e1a6-bb58-4b13-9dfe-4bd98bd09209 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:06.286966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2e1a6-bb58-4b13-9dfe-4bd98bd09209 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:06.287274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2e1a6-bb58-4b13-9dfe-4bd98bd09209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:06.288709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2e1a6-bb58-4b13-9dfe-4bd98bd09209 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:06.301227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 8/15] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:06.306134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f2390-22ea-4bec-a9dd-3ed27e431376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:06.306979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2e1a6-bb58-4b13-9dfe-4bd98bd09209 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:06.308037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f2390-22ea-4bec-a9dd-3ed27e431376 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:06.407752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2e1a6-bb58-4b13-9dfe-4bd98bd09209 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:06.411328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 8/16] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:50:06.416943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f2390-22ea-4bec-a9dd-3ed27e431376 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:06.419776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:06.443632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8771ff-6343-4602-bdaf-40d633791dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:06.444536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8771ff-6343-4602-bdaf-40d633791dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:06.444814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8771ff-6343-4602-bdaf-40d633791dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:06.445086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8771ff-6343-4602-bdaf-40d633791dc0 None admin] PATH_INFO: `/v3/users/ea0bb7d073ca4a9588a262eed95c091c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:06.446224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8771ff-6343-4602-bdaf-40d633791dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0bb7d073ca4a9588a262eed95c091c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:06.447696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8771ff-6343-4602-bdaf-40d633791dc0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:06.449306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 9/17] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:06 2022] GET /identity/v3/users/ea0bb7d073ca4a9588a262eed95c091c => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:06.454765 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8771ff-6343-4602-bdaf-40d633791dc0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:06.469821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:06.517949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f2390-22ea-4bec-a9dd-3ed27e431376 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:06.553957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbe939-690b-4b65-82a9-8067e2f46d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:06.554820 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbe939-690b-4b65-82a9-8067e2f46d17 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:06.555104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbe939-690b-4b65-82a9-8067e2f46d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:06.555287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8771ff-6343-4602-bdaf-40d633791dc0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:06.555382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbe939-690b-4b65-82a9-8067e2f46d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:06.574259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbe939-690b-4b65-82a9-8067e2f46d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:06.575851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbe939-690b-4b65-82a9-8067e2f46d17 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:06.589084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880def7-6183-41d6-991b-1728b867a5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:06.590065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880def7-6183-41d6-991b-1728b867a5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:06.590065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880def7-6183-41d6-991b-1728b867a5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:06.590255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880def7-6183-41d6-991b-1728b867a5b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:06.591377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880def7-6183-41d6-991b-1728b867a5b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:06.592843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880def7-6183-41d6-991b-1728b867a5b7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:06.594407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 10/18] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-39cbe939-690b-4b65-82a9-8067e2f46d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:50:06.594702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:06.596196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:50:06.597306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:50:06.597306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:50:06.597306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:06.597306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 9/19] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:50:06.600343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880def7-6183-41d6-991b-1728b867a5b7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:06.602010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbe939-690b-4b65-82a9-8067e2f46d17 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:06.659221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:06.682323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:06.701556 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880def7-6183-41d6-991b-1728b867a5b7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:06.703779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbe939-690b-4b65-82a9-8067e2f46d17 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:06.740355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c9188-1ab1-43f9-b751-c312cce17783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:06.741018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c9188-1ab1-43f9-b751-c312cce17783 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:06.741557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c9188-1ab1-43f9-b751-c312cce17783 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:06.741837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c9188-1ab1-43f9-b751-c312cce17783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:06.742574 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c9188-1ab1-43f9-b751-c312cce17783 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.domain.id=default, user.id=ea0bb7d073ca4a9588a262eed95c091c) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:06.742887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c9188-1ab1-43f9-b751-c312cce17783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:06.744354 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c9188-1ab1-43f9-b751-c312cce17783 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:06.744858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559cdd7-6f5b-4f1c-9f8e-3796fbc73398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:06.745471 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559cdd7-6f5b-4f1c-9f8e-3796fbc73398 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:06.745749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559cdd7-6f5b-4f1c-9f8e-3796fbc73398 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:06.746018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559cdd7-6f5b-4f1c-9f8e-3796fbc73398 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:06.746661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559cdd7-6f5b-4f1c-9f8e-3796fbc73398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:06.746963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559cdd7-6f5b-4f1c-9f8e-3796fbc73398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:06.748322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559cdd7-6f5b-4f1c-9f8e-3796fbc73398 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:06.751314 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 11/20] 10.222.0.81 () {56 vars in 1322 bytes} [Thu Aug 18 16:50:06 2022] GET /identity/v3/role_assignments?user.id=ea0bb7d073ca4a9588a262eed95c091c&scope.domain.id=default&role.id=56228137a4444ef9b7e688d04abd00fd => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:06.766932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 10/21] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:09.017563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc235d7e-a986-4871-a03d-58732bbc243c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:09.018054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc235d7e-a986-4871-a03d-58732bbc243c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:09.018054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc235d7e-a986-4871-a03d-58732bbc243c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:09.019689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 12/22] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:09.025407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce3a2-7c3a-4802-9a4c-a6bf09e71904 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:09.026236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce3a2-7c3a-4802-9a4c-a6bf09e71904 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:09.026722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce3a2-7c3a-4802-9a4c-a6bf09e71904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:09.057558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-801ce3a2-7c3a-4802-9a4c-a6bf09e71904 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:09.059138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-801ce3a2-7c3a-4802-9a4c-a6bf09e71904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:09.084054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324660-bc00-4bd8-9d12-536f2fe802b5 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:09.084684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324660-bc00-4bd8-9d12-536f2fe802b5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:09.085174 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324660-bc00-4bd8-9d12-536f2fe802b5 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:09.086710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 13/23] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:09.094179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33856d39-b64e-477a-8834-2218c7505174 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:09.094738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33856d39-b64e-477a-8834-2218c7505174 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:09.095226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33856d39-b64e-477a-8834-2218c7505174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:09.119280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-33856d39-b64e-477a-8834-2218c7505174 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:09.121686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-33856d39-b64e-477a-8834-2218c7505174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:09.166289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 11/24] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:09.167521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fd71f-4862-4ba0-8a92-44d55daa0504 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:09.167813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fd71f-4862-4ba0-8a92-44d55daa0504 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:09.168090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fd71f-4862-4ba0-8a92-44d55daa0504 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:09.169429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 12/25] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:09.174705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6fee0-bec5-4089-915e-9ea8ac68fc1e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:09.175091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6fee0-bec5-4089-915e-9ea8ac68fc1e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:09.175437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6fee0-bec5-4089-915e-9ea8ac68fc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:09.194814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-56c6fee0-bec5-4089-915e-9ea8ac68fc1e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:09.196100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-56c6fee0-bec5-4089-915e-9ea8ac68fc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:09.242390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:09.269557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 13/26] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:09.270304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 14/27] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:09.580490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6fee0-bec5-4089-915e-9ea8ac68fc1e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:09.620133 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7186bf-e4ba-442b-84b3-54e72f81f679 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:09.620594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7186bf-e4ba-442b-84b3-54e72f81f679 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:09.620974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7186bf-e4ba-442b-84b3-54e72f81f679 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:09.622612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 15/28] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:09.628626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f74c9-12ad-41d0-ae09-c4cfc373700e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:09.629026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f74c9-12ad-41d0-ae09-c4cfc373700e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:09.629761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f74c9-12ad-41d0-ae09-c4cfc373700e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:09.651293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8e5f74c9-12ad-41d0-ae09-c4cfc373700e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:09.652966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8e5f74c9-12ad-41d0-ae09-c4cfc373700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:09.732285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6fee0-bec5-4089-915e-9ea8ac68fc1e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:09.770791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 16/29] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:09.771603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f74c9-12ad-41d0-ae09-c4cfc373700e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:09.776811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:09.780409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c6059-551e-4f7d-977b-db09929067ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:09.781397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6059-551e-4f7d-977b-db09929067ab None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:09.781878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6059-551e-4f7d-977b-db09929067ab None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:09.782934 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c6059-551e-4f7d-977b-db09929067ab None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:09.783192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c6059-551e-4f7d-977b-db09929067ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:09.784984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c6059-551e-4f7d-977b-db09929067ab None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:09.927906 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 14/30] 10.222.0.81 () {60 vars in 1131 bytes} [Thu Aug 18 16:50:09 2022] POST /identity/v3/roles => generated 219 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:50:09.933571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c6059-551e-4f7d-977b-db09929067ab None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:09.991631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f74c9-12ad-41d0-ae09-c4cfc373700e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:10.001754 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:10.058784 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3369566-8962-46cd-ae75-23d197aaabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:10.059472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369566-8962-46cd-ae75-23d197aaabda None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.059734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369566-8962-46cd-ae75-23d197aaabda None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.060010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3369566-8962-46cd-ae75-23d197aaabda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.082391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3369566-8962-46cd-ae75-23d197aaabda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:10.083933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3369566-8962-46cd-ae75-23d197aaabda None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f3369566-8962-46cd-ae75-23d197aaabda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:50:10.110220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:10.111187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:50:10.112000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:50:10.112000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:50:10.112000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:10.112832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 17/31] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:10.118226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3369566-8962-46cd-ae75-23d197aaabda None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:10.197900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c6059-551e-4f7d-977b-db09929067ab None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:10.204867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:10.254605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4323-5095-4c99-a285-796111b46cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:10.255780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4323-5095-4c99-a285-796111b46cba None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.256322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4323-5095-4c99-a285-796111b46cba None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.256889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4323-5095-4c99-a285-796111b46cba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.261946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3369566-8962-46cd-ae75-23d197aaabda None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:10.270474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f4323-5095-4c99-a285-796111b46cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-bf3f4323-5095-4c99-a285-796111b46cba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:10.277723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:10.278633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:10.279524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:10.282082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 15/32] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:50:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:10.283109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4323-5095-4c99-a285-796111b46cba None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:10.303232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902d545-b47b-4565-8ff1-d3e54b3798c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:10.303897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902d545-b47b-4565-8ff1-d3e54b3798c7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.304183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902d545-b47b-4565-8ff1-d3e54b3798c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.304467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902d545-b47b-4565-8ff1-d3e54b3798c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.305124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902d545-b47b-4565-8ff1-d3e54b3798c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:10.305426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902d545-b47b-4565-8ff1-d3e54b3798c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:10.306827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902d545-b47b-4565-8ff1-d3e54b3798c7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:10.327932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 18/33] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:10.328900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902d545-b47b-4565-8ff1-d3e54b3798c7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:10.398104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4323-5095-4c99-a285-796111b46cba None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:10.416835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:10.436995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d8d4-7884-4fbb-855a-f455a06c2e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:10.437833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d8d4-7884-4fbb-855a-f455a06c2e95 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.438220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d8d4-7884-4fbb-855a-f455a06c2e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.438656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d8d4-7884-4fbb-855a-f455a06c2e95 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.439534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5d8d4-7884-4fbb-855a-f455a06c2e95 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:10.441727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5d8d4-7884-4fbb-855a-f455a06c2e95 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:10.442583 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902d545-b47b-4565-8ff1-d3e54b3798c7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:10.459761 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 16/34] 10.222.0.81 () {60 vars in 1131 bytes} [Thu Aug 18 16:50:10 2022] POST /identity/v3/roles => generated 225 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:50:10.460744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:10.461973 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d8d4-7884-4fbb-855a-f455a06c2e95 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:10.480503 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e695-50a9-4412-a766-1fa4c395cc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:10.481128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e695-50a9-4412-a766-1fa4c395cc0d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.481410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e695-50a9-4412-a766-1fa4c395cc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.481743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e695-50a9-4412-a766-1fa4c395cc0d None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.482438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e695-50a9-4412-a766-1fa4c395cc0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:10.482792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e695-50a9-4412-a766-1fa4c395cc0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:10.484238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e695-50a9-4412-a766-1fa4c395cc0d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:10.493758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 19/35] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:10.499781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e695-50a9-4412-a766-1fa4c395cc0d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:10.639511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d8d4-7884-4fbb-855a-f455a06c2e95 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:10.640817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e695-50a9-4412-a766-1fa4c395cc0d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:10.681235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1aba9b-82f6-4fa7-80d4-8ebe346c4e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:10.682713 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4807-7a26-4357-9aad-662bde364a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:10.683363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4807-7a26-4357-9aad-662bde364a82 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.683646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4807-7a26-4357-9aad-662bde364a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.683925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4807-7a26-4357-9aad-662bde364a82 None admin] PATH_INFO: `/v3/users/ea0bb7d073ca4a9588a262eed95c091c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.685143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aba9b-82f6-4fa7-80d4-8ebe346c4e24 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.685420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aba9b-82f6-4fa7-80d4-8ebe346c4e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.685695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aba9b-82f6-4fa7-80d4-8ebe346c4e24 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.686624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1aba9b-82f6-4fa7-80d4-8ebe346c4e24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:10.688093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1aba9b-82f6-4fa7-80d4-8ebe346c4e24 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:10.692298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e4807-7a26-4357-9aad-662bde364a82 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0bb7d073ca4a9588a262eed95c091c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:10.693822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e4807-7a26-4357-9aad-662bde364a82 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:10.700208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 20/36] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:10 2022] GET /identity/v3/users/ea0bb7d073ca4a9588a262eed95c091c => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:10.700208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042bd1-31e2-4f13-8964-3fcc3a37e0fd None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.700208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042bd1-31e2-4f13-8964-3fcc3a37e0fd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.700208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042bd1-31e2-4f13-8964-3fcc3a37e0fd None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.700208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 21/37] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:10.704407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61042bd1-31e2-4f13-8964-3fcc3a37e0fd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:10.733200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 17/38] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:50:10 2022] POST /identity/v3/projects => generated 301 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:50:10.741335 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90cfa8-d8c9-4bbc-969e-f4923805eac5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.741847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90cfa8-d8c9-4bbc-969e-f4923805eac5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.742330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90cfa8-d8c9-4bbc-969e-f4923805eac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.764725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6e90cfa8-d8c9-4bbc-969e-f4923805eac5 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:10.766724 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6e90cfa8-d8c9-4bbc-969e-f4923805eac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:10.770559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:10.787050 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:10.851403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61042bd1-31e2-4f13-8964-3fcc3a37e0fd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:10.871988 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 18/39] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:10.886030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df58413-fc0d-46b4-8972-5a8fafff6b16 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.886322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df58413-fc0d-46b4-8972-5a8fafff6b16 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.886604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df58413-fc0d-46b4-8972-5a8fafff6b16 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.888138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 19/40] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:10.895045 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da206c1-7f95-4579-822e-a549f0cfe4b2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.895327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da206c1-7f95-4579-822e-a549f0cfe4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.895619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da206c1-7f95-4579-822e-a549f0cfe4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.899651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c38f7-c51f-418c-9a40-576618c2eca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:10.900300 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c38f7-c51f-418c-9a40-576618c2eca0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:10.900621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c38f7-c51f-418c-9a40-576618c2eca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:10.900901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c38f7-c51f-418c-9a40-576618c2eca0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:10.902109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c38f7-c51f-418c-9a40-576618c2eca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:10.903962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c38f7-c51f-418c-9a40-576618c2eca0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:10.906398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 22/41] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:10.912179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c38f7-c51f-418c-9a40-576618c2eca0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:10.915131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2da206c1-7f95-4579-822e-a549f0cfe4b2 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:10.916452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2da206c1-7f95-4579-822e-a549f0cfe4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:10.996564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 20/42] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:11.039186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c38f7-c51f-418c-9a40-576618c2eca0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:11.055076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:11.079058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1f8e0-ae9f-40cf-962e-c464cbc9fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:11.079727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1f8e0-ae9f-40cf-962e-c464cbc9fbb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:11.079997 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1f8e0-ae9f-40cf-962e-c464cbc9fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:11.080275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1f8e0-ae9f-40cf-962e-c464cbc9fbb2 None admin] PATH_INFO: `/v3/domains/default/users/ea0bb7d073ca4a9588a262eed95c091c/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:11.082287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1f8e0-ae9f-40cf-962e-c464cbc9fbb2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ea0bb7d073ca4a9588a262eed95c091c, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:11.083777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1f8e0-ae9f-40cf-962e-c464cbc9fbb2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:11.146233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da206c1-7f95-4579-822e-a549f0cfe4b2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:11.221633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:11.262555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da206c1-7f95-4579-822e-a549f0cfe4b2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:11.299644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126573b-1be7-42c4-a455-efe1f4b1d55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:11.300864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126573b-1be7-42c4-a455-efe1f4b1d55a None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:11.301148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126573b-1be7-42c4-a455-efe1f4b1d55a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:11.301426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126573b-1be7-42c4-a455-efe1f4b1d55a None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:11.302098 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126573b-1be7-42c4-a455-efe1f4b1d55a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:11.303218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 23/43] 10.222.0.81 () {58 vars in 1361 bytes} [Thu Aug 18 16:50:10 2022] PUT /identity/v3/domains/default/users/ea0bb7d073ca4a9588a262eed95c091c/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:11.303480 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126573b-1be7-42c4-a455-efe1f4b1d55a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:11.305600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1f8e0-ae9f-40cf-962e-c464cbc9fbb2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:11.320410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 21/44] 10.222.0.81 () {60 vars in 1131 bytes} [Thu Aug 18 16:50:11 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:50:11.435963 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1f8e0-ae9f-40cf-962e-c464cbc9fbb2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:11.476103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3f2b0-e659-4209-b9ab-41fdca099e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:11.476791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3f2b0-e659-4209-b9ab-41fdca099e76 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:11.477073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3f2b0-e659-4209-b9ab-41fdca099e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:11.477362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3f2b0-e659-4209-b9ab-41fdca099e76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:11.478586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3f2b0-e659-4209-b9ab-41fdca099e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:11.480234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3f2b0-e659-4209-b9ab-41fdca099e76 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:11.485021 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 24/45] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:11.490331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126573b-1be7-42c4-a455-efe1f4b1d55a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:11.596030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126573b-1be7-42c4-a455-efe1f4b1d55a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:11.622182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:11.631077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ce498-ec9d-4f53-b53a-b48ca72e82a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:11.631706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ce498-ec9d-4f53-b53a-b48ca72e82a8 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:11.631981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ce498-ec9d-4f53-b53a-b48ca72e82a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:11.632260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ce498-ec9d-4f53-b53a-b48ca72e82a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:11.632949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ce498-ec9d-4f53-b53a-b48ca72e82a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:11.634419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ce498-ec9d-4f53-b53a-b48ca72e82a8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:11.662133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 22/46] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:50:11 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:50:13.227072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400a2a-db60-44d2-9950-3e2cedb3d19b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:13.227594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400a2a-db60-44d2-9950-3e2cedb3d19b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:13.227594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400a2a-db60-44d2-9950-3e2cedb3d19b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:13.228993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 25/47] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:13.234086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9e32b-64ec-4c60-b75d-11fdadac8322 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:13.234499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9e32b-64ec-4c60-b75d-11fdadac8322 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:13.234776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9e32b-64ec-4c60-b75d-11fdadac8322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:13.253952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b0d9e32b-64ec-4c60-b75d-11fdadac8322 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:13.255551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b0d9e32b-64ec-4c60-b75d-11fdadac8322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:13.322424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 23/48] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:13.559471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651bfd4-26b3-4515-9362-9aa9f41aa66f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:13.559681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651bfd4-26b3-4515-9362-9aa9f41aa66f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:13.559967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651bfd4-26b3-4515-9362-9aa9f41aa66f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:13.561366 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 26/49] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:13.566616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8936e-3c22-4ce2-adae-ef642516b662 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:13.567006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8936e-3c22-4ce2-adae-ef642516b662 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:13.567358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8936e-3c22-4ce2-adae-ef642516b662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:13.585399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-41f8936e-3c22-4ce2-adae-ef642516b662 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:13.586615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-41f8936e-3c22-4ce2-adae-ef642516b662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:13.587665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651bfd4-26b3-4515-9362-9aa9f41aa66f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:13.633758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:13.653405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 24/50] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:13.694056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651bfd4-26b3-4515-9362-9aa9f41aa66f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:13.728950 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f2026-f55d-4047-929d-b9780f0dbaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:13.729594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2026-f55d-4047-929d-b9780f0dbaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:13.729881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2026-f55d-4047-929d-b9780f0dbaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:13.730161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2026-f55d-4047-929d-b9780f0dbaf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:13.743446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f2026-f55d-4047-929d-b9780f0dbaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-190f2026-f55d-4047-929d-b9780f0dbaf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:13.748234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:13.749343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:13.750549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 27/51] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:50:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:50:13.755695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8936e-3c22-4ce2-adae-ef642516b662 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:13.795411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:13.852129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8936e-3c22-4ce2-adae-ef642516b662 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:13.885382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc2dd2-4e3c-40d3-b377-a9db32f0a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:13.885993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc2dd2-4e3c-40d3-b377-a9db32f0a46f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:13.886275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc2dd2-4e3c-40d3-b377-a9db32f0a46f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:13.886552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc2dd2-4e3c-40d3-b377-a9db32f0a46f None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:13.887211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc2dd2-4e3c-40d3-b377-a9db32f0a46f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:13.887516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc2dd2-4e3c-40d3-b377-a9db32f0a46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:13.888936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc2dd2-4e3c-40d3-b377-a9db32f0a46f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:13.900512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 25/52] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:13.906356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f2026-f55d-4047-929d-b9780f0dbaf2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:13.926461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc2dd2-4e3c-40d3-b377-a9db32f0a46f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:14.008762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f2026-f55d-4047-929d-b9780f0dbaf2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:14.010293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:14.026170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc2dd2-4e3c-40d3-b377-a9db32f0a46f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:14.027683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:14.044993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfee17-145d-4751-9897-3e9cad1943c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:14.045629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfee17-145d-4751-9897-3e9cad1943c4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:14.045913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfee17-145d-4751-9897-3e9cad1943c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:14.046190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfee17-145d-4751-9897-3e9cad1943c4 None admin] PATH_INFO: `/v3/users/ea0bb7d073ca4a9588a262eed95c091c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:14.047398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfee17-145d-4751-9897-3e9cad1943c4 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0bb7d073ca4a9588a262eed95c091c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:14.048878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfee17-145d-4751-9897-3e9cad1943c4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:14.050512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 28/53] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:13 2022] GET /identity/v3/users/ea0bb7d073ca4a9588a262eed95c091c => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:14.055987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfee17-145d-4751-9897-3e9cad1943c4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:14.060521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4189-34cb-4130-9f43-1db3e3898e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:14.061173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4189-34cb-4130-9f43-1db3e3898e89 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:14.061458 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4189-34cb-4130-9f43-1db3e3898e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:14.061736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4189-34cb-4130-9f43-1db3e3898e89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:14.062882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b4189-34cb-4130-9f43-1db3e3898e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:14.064346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b4189-34cb-4130-9f43-1db3e3898e89 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:14.066519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 26/54] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:14.072104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4189-34cb-4130-9f43-1db3e3898e89 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:14.155784 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfee17-145d-4751-9897-3e9cad1943c4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:14.171085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4189-34cb-4130-9f43-1db3e3898e89 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:14.188775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c6034-5249-427a-ae69-ef2b8d120c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:14.189406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6034-5249-427a-ae69-ef2b8d120c0a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:14.189691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6034-5249-427a-ae69-ef2b8d120c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:14.189973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6034-5249-427a-ae69-ef2b8d120c0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:14.191604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c6034-5249-427a-ae69-ef2b8d120c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:14.193089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c6034-5249-427a-ae69-ef2b8d120c0a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:14.194696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 29/55] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:14.200406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c6034-5249-427a-ae69-ef2b8d120c0a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:14.204266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8398d0e-ab99-4b19-9435-90bc4f10208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:14.204904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8398d0e-ab99-4b19-9435-90bc4f10208a None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:14.205189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8398d0e-ab99-4b19-9435-90bc4f10208a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:14.205466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8398d0e-ab99-4b19-9435-90bc4f10208a None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:14.206680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8398d0e-ab99-4b19-9435-90bc4f10208a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:14.208125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8398d0e-ab99-4b19-9435-90bc4f10208a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:14.235333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 27/56] 10.222.0.81 () {60 vars in 1140 bytes} [Thu Aug 18 16:50:14 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:50:14.242221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:14.309684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c6034-5249-427a-ae69-ef2b8d120c0a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:14.346449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383ade-db6a-40f1-a883-6c50c2c2d683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:14.347087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383ade-db6a-40f1-a883-6c50c2c2d683 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:14.347373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383ade-db6a-40f1-a883-6c50c2c2d683 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:14.347654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383ade-db6a-40f1-a883-6c50c2c2d683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:14.348408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383ade-db6a-40f1-a883-6c50c2c2d683 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.domain.id=default, user.id=ea0bb7d073ca4a9588a262eed95c091c) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:14.348757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383ade-db6a-40f1-a883-6c50c2c2d683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:14.350289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383ade-db6a-40f1-a883-6c50c2c2d683 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:14.356782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 30/57] 10.222.0.81 () {56 vars in 1322 bytes} [Thu Aug 18 16:50:14 2022] GET /identity/v3/role_assignments?user.id=ea0bb7d073ca4a9588a262eed95c091c&scope.domain.id=default&role.id=56228137a4444ef9b7e688d04abd00fd => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:16.126917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326921e-96cc-4d95-91bd-ade0eeaf7849 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:16.127414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326921e-96cc-4d95-91bd-ade0eeaf7849 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:16.127414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326921e-96cc-4d95-91bd-ade0eeaf7849 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:16.128800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 28/58] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:16.133873 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e1fa-4b2d-445d-a963-c0044147a49a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:16.134257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e1fa-4b2d-445d-a963-c0044147a49a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:16.134430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e1fa-4b2d-445d-a963-c0044147a49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:16.152662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e3b3e1fa-4b2d-445d-a963-c0044147a49a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:16.154169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e3b3e1fa-4b2d-445d-a963-c0044147a49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:16.218217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 31/59] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:16.485069 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326921e-96cc-4d95-91bd-ade0eeaf7849 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:16.509595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:16.585148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326921e-96cc-4d95-91bd-ade0eeaf7849 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:16.620260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc2377-7a94-4198-ade9-e70441ac9a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:16.620921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc2377-7a94-4198-ade9-e70441ac9a33 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:16.621204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc2377-7a94-4198-ade9-e70441ac9a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:16.621479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc2377-7a94-4198-ade9-e70441ac9a33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:16.622583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc2377-7a94-4198-ade9-e70441ac9a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:16.624039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc2377-7a94-4198-ade9-e70441ac9a33 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:16.625615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 29/60] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:16.631261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3e1fa-4b2d-445d-a963-c0044147a49a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:16.661381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:16.730245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3e1fa-4b2d-445d-a963-c0044147a49a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:16.763702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25042060-85f8-434d-af74-f6aa8f262554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:16.764317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042060-85f8-434d-af74-f6aa8f262554 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:16.764637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042060-85f8-434d-af74-f6aa8f262554 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:16.764913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042060-85f8-434d-af74-f6aa8f262554 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:16.765568 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25042060-85f8-434d-af74-f6aa8f262554 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:16.767021 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25042060-85f8-434d-af74-f6aa8f262554 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:16.794688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 32/61] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:50:16 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:50:19.606178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f6b68-37aa-4f11-b841-0deb8252bc6e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:19.606721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f6b68-37aa-4f11-b841-0deb8252bc6e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:19.606721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f6b68-37aa-4f11-b841-0deb8252bc6e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:19.608254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 30/62] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:19.626018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0975-4a6c-43f7-8f78-3ca808bb6f2e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:19.626507 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0975-4a6c-43f7-8f78-3ca808bb6f2e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:19.626581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0975-4a6c-43f7-8f78-3ca808bb6f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:19.657505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9d1e0975-4a6c-43f7-8f78-3ca808bb6f2e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:19.658734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9d1e0975-4a6c-43f7-8f78-3ca808bb6f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:19.764514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 33/63] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:19.910482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c075c-ef17-40b3-860a-d43df8e2a185 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:19.910808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c075c-ef17-40b3-860a-d43df8e2a185 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:19.910977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c075c-ef17-40b3-860a-d43df8e2a185 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:19.912313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 31/64] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:19.926953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed40820-8bb2-45e5-8f4a-81118cdbf0dd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:19.927244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed40820-8bb2-45e5-8f4a-81118cdbf0dd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:19.927524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed40820-8bb2-45e5-8f4a-81118cdbf0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:19.953115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-fed40820-8bb2-45e5-8f4a-81118cdbf0dd None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:19.954313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fed40820-8bb2-45e5-8f4a-81118cdbf0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:19.967823 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56ab7d-7bf5-4aa5-bc8c-6c8c8d421c92 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:19.968482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56ab7d-7bf5-4aa5-bc8c-6c8c8d421c92 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:19.968983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56ab7d-7bf5-4aa5-bc8c-6c8c8d421c92 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:19.969470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:19.973176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 32/65] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:19.979972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a91010-b643-46b6-a5ed-d709257c8acb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:19.980604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a91010-b643-46b6-a5ed-d709257c8acb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:19.981156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a91010-b643-46b6-a5ed-d709257c8acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.087012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 34/66] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:20.124234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed40820-8bb2-45e5-8f4a-81118cdbf0dd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:20.150362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-30a91010-b643-46b6-a5ed-d709257c8acb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:20.151578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-30a91010-b643-46b6-a5ed-d709257c8acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:20.291168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 33/67] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:20.307297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed40820-8bb2-45e5-8f4a-81118cdbf0dd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:20.354968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0a071-45d3-4a3f-81a0-65175c1cd6b6 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:20.355275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0a071-45d3-4a3f-81a0-65175c1cd6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:20.355533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0a071-45d3-4a3f-81a0-65175c1cd6b6 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.357033 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 34/68] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:20.363195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac611ea5-cc14-4a18-b030-ac0e1ede6cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:20.363857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac611ea5-cc14-4a18-b030-ac0e1ede6cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:20.364145 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac611ea5-cc14-4a18-b030-ac0e1ede6cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:20.364422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac611ea5-cc14-4a18-b030-ac0e1ede6cc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.366582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123bb43-d969-4e8d-b18d-f0c6c38d469f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:20.366859 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123bb43-d969-4e8d-b18d-f0c6c38d469f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:20.367132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123bb43-d969-4e8d-b18d-f0c6c38d469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.384280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac611ea5-cc14-4a18-b030-ac0e1ede6cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:20.388622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9123bb43-d969-4e8d-b18d-f0c6c38d469f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ac611ea5-cc14-4a18-b030-ac0e1ede6cc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:20.389837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:20.390952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:20.391906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:20.392900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 35/69] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:50:20.393303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9123bb43-d969-4e8d-b18d-f0c6c38d469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:20.393769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac611ea5-cc14-4a18-b030-ac0e1ede6cc3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:20.407865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:20.414747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:20.480925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 35/70] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 18 16:50:20.482365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123bb43-d969-4e8d-b18d-f0c6c38d469f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:20.520986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac611ea5-cc14-4a18-b030-ac0e1ede6cc3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:20.560267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb869db3-5049-4467-b77c-4dbe622b125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:20.561310 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb869db3-5049-4467-b77c-4dbe622b125a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:20.561775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb869db3-5049-4467-b77c-4dbe622b125a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:20.562229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb869db3-5049-4467-b77c-4dbe622b125a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.573829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb869db3-5049-4467-b77c-4dbe622b125a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-cb869db3-5049-4467-b77c-4dbe622b125a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:20.579182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:20.580042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:20.581394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:20.583769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 36/71] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:50:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:20.589399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb869db3-5049-4467-b77c-4dbe622b125a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:20.591507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123bb43-d969-4e8d-b18d-f0c6c38d469f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:20.628518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e2461-462e-4c64-adfc-4f49e0dae21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:20.629320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e2461-462e-4c64-adfc-4f49e0dae21e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:20.629822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e2461-462e-4c64-adfc-4f49e0dae21e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:20.630291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e2461-462e-4c64-adfc-4f49e0dae21e None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.631234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e2461-462e-4c64-adfc-4f49e0dae21e None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:20.631753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e2461-462e-4c64-adfc-4f49e0dae21e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:20.633393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e2461-462e-4c64-adfc-4f49e0dae21e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:20.642232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 36/72] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:20.643903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e2461-462e-4c64-adfc-4f49e0dae21e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:20.663528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:20.671486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:20.710694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb869db3-5049-4467-b77c-4dbe622b125a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:20.751687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9e34e-adb0-4ddc-963a-e987cfc49261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:20.752616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9e34e-adb0-4ddc-963a-e987cfc49261 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:20.753096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9e34e-adb0-4ddc-963a-e987cfc49261 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:20.753516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9e34e-adb0-4ddc-963a-e987cfc49261 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.757798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e2461-462e-4c64-adfc-4f49e0dae21e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:20.764892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9e34e-adb0-4ddc-963a-e987cfc49261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-08d9e34e-adb0-4ddc-963a-e987cfc49261 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:20.770213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:20.771055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 37/73] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:50:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:20.772202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9e34e-adb0-4ddc-963a-e987cfc49261 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:20.793494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1e923-dd3d-44d8-8fad-6b91b1727f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:20.794113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1e923-dd3d-44d8-8fad-6b91b1727f97 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:20.794398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1e923-dd3d-44d8-8fad-6b91b1727f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:20.794680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1e923-dd3d-44d8-8fad-6b91b1727f97 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.795351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1e923-dd3d-44d8-8fad-6b91b1727f97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:20.795658 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1e923-dd3d-44d8-8fad-6b91b1727f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:20.797140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1e923-dd3d-44d8-8fad-6b91b1727f97 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:20.812578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 37/74] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:20.812578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc10a38-f4ce-4193-a19c-39928f687b14 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:20.812578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc10a38-f4ce-4193-a19c-39928f687b14 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:20.812578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc10a38-f4ce-4193-a19c-39928f687b14 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.812578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 38/75] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:20.812578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc10a38-f4ce-4193-a19c-39928f687b14 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:20.883237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9e34e-adb0-4ddc-963a-e987cfc49261 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:20.889784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:20.909554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:20.915364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc10a38-f4ce-4193-a19c-39928f687b14 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:20.918022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70941351-1c78-4ce8-8431-e43322b7a26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:20.918660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70941351-1c78-4ce8-8431-e43322b7a26d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:20.918946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70941351-1c78-4ce8-8431-e43322b7a26d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:20.919229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70941351-1c78-4ce8-8431-e43322b7a26d None admin] PATH_INFO: `/v3/users/735fc3fffec44536b08892ae5de87f8a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.933027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70941351-1c78-4ce8-8431-e43322b7a26d None admin] RBAC: Authorizing `identity:get_user(user_id=735fc3fffec44536b08892ae5de87f8a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:20.934508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70941351-1c78-4ce8-8431-e43322b7a26d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:20.936155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 38/76] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:20 2022] GET /identity/v3/users/735fc3fffec44536b08892ae5de87f8a => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:20.937021 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70941351-1c78-4ce8-8431-e43322b7a26d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:20.954565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ce8e-0ad4-4510-8594-00788d877661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:20.955402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ce8e-0ad4-4510-8594-00788d877661 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:20.955511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ce8e-0ad4-4510-8594-00788d877661 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:20.955733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ce8e-0ad4-4510-8594-00788d877661 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:20.956523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694ce8e-0ad4-4510-8594-00788d877661 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:20.956834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694ce8e-0ad4-4510-8594-00788d877661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:20.958244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694ce8e-0ad4-4510-8594-00788d877661 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:20.966230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 39/77] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:50:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:20.967020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ce8e-0ad4-4510-8594-00788d877661 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:21.042164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70941351-1c78-4ce8-8431-e43322b7a26d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:21.065035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ce8e-0ad4-4510-8594-00788d877661 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:21.077034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d97b4-0260-439d-9670-080f05a55117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:21.077754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d97b4-0260-439d-9670-080f05a55117 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:21.078045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d97b4-0260-439d-9670-080f05a55117 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:21.078325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d97b4-0260-439d-9670-080f05a55117 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:21.089305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d97b4-0260-439d-9670-080f05a55117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4a2d97b4-0260-439d-9670-080f05a55117 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:21.094033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:21.095082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 39/78] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:21.097285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc5fed-df2f-456a-ac2e-852f7e7a6fcc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:21.098003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc5fed-df2f-456a-ac2e-852f7e7a6fcc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:21.098003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc5fed-df2f-456a-ac2e-852f7e7a6fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:21.104699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d68448-5b6a-4566-bdd8-22b6b41ef9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:21.105405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68448-5b6a-4566-bdd8-22b6b41ef9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:21.105695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68448-5b6a-4566-bdd8-22b6b41ef9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:21.105972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68448-5b6a-4566-bdd8-22b6b41ef9c5 None admin] PATH_INFO: `/v3/users/ea0bb7d073ca4a9588a262eed95c091c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:21.107345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d68448-5b6a-4566-bdd8-22b6b41ef9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0bb7d073ca4a9588a262eed95c091c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:21.108810 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d68448-5b6a-4566-bdd8-22b6b41ef9c5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:21.110384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 40/79] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:20 2022] GET /identity/v3/users/ea0bb7d073ca4a9588a262eed95c091c => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:21.111231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d68448-5b6a-4566-bdd8-22b6b41ef9c5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:21.114755 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:21.117416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cbcc5fed-df2f-456a-ac2e-852f7e7a6fcc None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:21.118648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cbcc5fed-df2f-456a-ac2e-852f7e7a6fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:21.162132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:21.186195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 40/80] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:21.189337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc5fed-df2f-456a-ac2e-852f7e7a6fcc None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:21.213902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d68448-5b6a-4566-bdd8-22b6b41ef9c5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:21.253602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4d587-2e83-42e0-94e5-bb0d3c170e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:21.254949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4d587-2e83-42e0-94e5-bb0d3c170e08 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:21.255386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4d587-2e83-42e0-94e5-bb0d3c170e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:21.255844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4d587-2e83-42e0-94e5-bb0d3c170e08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:21.295166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc5fed-df2f-456a-ac2e-852f7e7a6fcc None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:21.331092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525a554-f84a-45a2-9f00-cd6c4dfb6c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:21.331657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525a554-f84a-45a2-9f00-cd6c4dfb6c82 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:21.331940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525a554-f84a-45a2-9f00-cd6c4dfb6c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:21.332219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525a554-f84a-45a2-9f00-cd6c4dfb6c82 None admin] PATH_INFO: `/v3/users/735fc3fffec44536b08892ae5de87f8a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:21.333384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525a554-f84a-45a2-9f00-cd6c4dfb6c82 None admin] RBAC: Authorizing `identity:get_user(user_id=735fc3fffec44536b08892ae5de87f8a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:21.334830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525a554-f84a-45a2-9f00-cd6c4dfb6c82 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:21.335977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4d587-2e83-42e0-94e5-bb0d3c170e08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:21.336615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 41/81] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:21 2022] GET /identity/v3/users/735fc3fffec44536b08892ae5de87f8a => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:21.337205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525a554-f84a-45a2-9f00-cd6c4dfb6c82 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:21.341585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4d587-2e83-42e0-94e5-bb0d3c170e08 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:21.344377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:21.390445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:21.449372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525a554-f84a-45a2-9f00-cd6c4dfb6c82 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:21.449559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 41/82] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:21.450375 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4d587-2e83-42e0-94e5-bb0d3c170e08 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:21.485395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a12f8d-8040-40b0-a3c8-42692065127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:21.486017 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a12f8d-8040-40b0-a3c8-42692065127a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:21.486307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a12f8d-8040-40b0-a3c8-42692065127a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:21.486596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a12f8d-8040-40b0-a3c8-42692065127a None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:21.487272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a12f8d-8040-40b0-a3c8-42692065127a None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:21.487644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a12f8d-8040-40b0-a3c8-42692065127a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:21.489021 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a12f8d-8040-40b0-a3c8-42692065127a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:21.497343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 42/83] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:21.498171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a12f8d-8040-40b0-a3c8-42692065127a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:21.550603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4d587-2e83-42e0-94e5-bb0d3c170e08 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:21.553051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:21.586616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef815-c41a-4d4b-86ce-d0c17752b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:21.587167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef815-c41a-4d4b-86ce-d0c17752b93a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:21.587448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef815-c41a-4d4b-86ce-d0c17752b93a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:21.587725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef815-c41a-4d4b-86ce-d0c17752b93a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:21.598074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a12f8d-8040-40b0-a3c8-42692065127a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:21.605091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:21.632740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac1755-e9a8-4b50-a8da-518e74facbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:21.633360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac1755-e9a8-4b50-a8da-518e74facbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:21.633649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac1755-e9a8-4b50-a8da-518e74facbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:21.633930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac1755-e9a8-4b50-a8da-518e74facbc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:21.655960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef815-c41a-4d4b-86ce-d0c17752b93a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:21.657466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef815-c41a-4d4b-86ce-d0c17752b93a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:21.701300 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac1755-e9a8-4b50-a8da-518e74facbc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:21.702791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac1755-e9a8-4b50-a8da-518e74facbc9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:21.757943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 42/84] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:21.758793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef815-c41a-4d4b-86ce-d0c17752b93a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:21.762278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:21.809440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 43/85] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:21.809440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac1755-e9a8-4b50-a8da-518e74facbc9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:21.819018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:21.862739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef815-c41a-4d4b-86ce-d0c17752b93a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:21.895899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80b758-315f-44b6-b8b8-7f696bb9cb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:21.896563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80b758-315f-44b6-b8b8-7f696bb9cb22 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:21.896851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80b758-315f-44b6-b8b8-7f696bb9cb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:21.897131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80b758-315f-44b6-b8b8-7f696bb9cb22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:21.898637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80b758-315f-44b6-b8b8-7f696bb9cb22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:21.900084 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80b758-315f-44b6-b8b8-7f696bb9cb22 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:21.901689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 43/86] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:21.902447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80b758-315f-44b6-b8b8-7f696bb9cb22 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:21.912924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac1755-e9a8-4b50-a8da-518e74facbc9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:21.946921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9388a-8420-43e4-b230-1de32e8e12c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:21.947588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9388a-8420-43e4-b230-1de32e8e12c2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:21.947884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9388a-8420-43e4-b230-1de32e8e12c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:21.948167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9388a-8420-43e4-b230-1de32e8e12c2 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:21.949367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9388a-8420-43e4-b230-1de32e8e12c2 None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:21.950852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9388a-8420-43e4-b230-1de32e8e12c2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:21.957862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 44/87] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:21 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:21.957862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9388a-8420-43e4-b230-1de32e8e12c2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:21.974132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:22.005907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80b758-315f-44b6-b8b8-7f696bb9cb22 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:22.029990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:22.038556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e6525-7e7e-4119-9da1-1cee94ca8ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:22.039200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e6525-7e7e-4119-9da1-1cee94ca8ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:22.039488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e6525-7e7e-4119-9da1-1cee94ca8ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:22.039765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e6525-7e7e-4119-9da1-1cee94ca8ba9 None admin] PATH_INFO: `/v3/users/735fc3fffec44536b08892ae5de87f8a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:22.040942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e6525-7e7e-4119-9da1-1cee94ca8ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=735fc3fffec44536b08892ae5de87f8a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:22.042389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e6525-7e7e-4119-9da1-1cee94ca8ba9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:22.043991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 44/88] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:21 2022] GET /identity/v3/users/735fc3fffec44536b08892ae5de87f8a => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:22.044788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e6525-7e7e-4119-9da1-1cee94ca8ba9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:22.059220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9388a-8420-43e4-b230-1de32e8e12c2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:22.093518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2de3d-b882-4d24-b58a-c72083f131c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:22.094154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2de3d-b882-4d24-b58a-c72083f131c3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:22.094445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2de3d-b882-4d24-b58a-c72083f131c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:22.094725 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2de3d-b882-4d24-b58a-c72083f131c3 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:22.095850 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2de3d-b882-4d24-b58a-c72083f131c3 None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:22.097331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2de3d-b882-4d24-b58a-c72083f131c3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:22.098973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 45/89] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:21 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:22.101306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2de3d-b882-4d24-b58a-c72083f131c3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:22.150155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e6525-7e7e-4119-9da1-1cee94ca8ba9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:22.183588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9a57-883e-4fc7-9d17-4d762e836c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:22.184229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9a57-883e-4fc7-9d17-4d762e836c13 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:22.184549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9a57-883e-4fc7-9d17-4d762e836c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:22.184835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9a57-883e-4fc7-9d17-4d762e836c13 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:22.185967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a9a57-883e-4fc7-9d17-4d762e836c13 None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:22.187438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a9a57-883e-4fc7-9d17-4d762e836c13 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:22.189113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 45/90] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:22 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:22.191156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9a57-883e-4fc7-9d17-4d762e836c13 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:22.202047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:22.202180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2de3d-b882-4d24-b58a-c72083f131c3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:22.235824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2078046-4a37-46fa-b403-ba4767b331a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:22.236441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2078046-4a37-46fa-b403-ba4767b331a7 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:22.236757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2078046-4a37-46fa-b403-ba4767b331a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:22.237575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2078046-4a37-46fa-b403-ba4767b331a7 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:22.238225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2078046-4a37-46fa-b403-ba4767b331a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:22.239670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2078046-4a37-46fa-b403-ba4767b331a7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:22.254920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:22.260124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 46/91] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:50:22 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:50:22.260124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2078046-4a37-46fa-b403-ba4767b331a7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:22.307574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9a57-883e-4fc7-9d17-4d762e836c13 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:22.349831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d70e4c-4c8b-4a9a-895c-a64ddf926fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:22.350532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d70e4c-4c8b-4a9a-895c-a64ddf926fca None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:22.350816 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d70e4c-4c8b-4a9a-895c-a64ddf926fca None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:22.351092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d70e4c-4c8b-4a9a-895c-a64ddf926fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:22.351955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d70e4c-4c8b-4a9a-895c-a64ddf926fca None admin] RBAC: Adding query filter params (role.id=6bf2c10dc09a4e9087fd12312566376f, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f, user.id=735fc3fffec44536b08892ae5de87f8a) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:22.352214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d70e4c-4c8b-4a9a-895c-a64ddf926fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:22.353751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d70e4c-4c8b-4a9a-895c-a64ddf926fca None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:22.363566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 46/92] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:22 2022] GET /identity/v3/role_assignments?user.id=735fc3fffec44536b08892ae5de87f8a&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:22.366284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d70e4c-4c8b-4a9a-895c-a64ddf926fca None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:22.390922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2078046-4a37-46fa-b403-ba4767b331a7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:22.439125 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d0267-3289-47be-a9a3-fbad02aa48af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:22.439824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d0267-3289-47be-a9a3-fbad02aa48af None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:22.440648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d0267-3289-47be-a9a3-fbad02aa48af None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:22.441691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d0267-3289-47be-a9a3-fbad02aa48af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:22.479777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:22.526323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d70e4c-4c8b-4a9a-895c-a64ddf926fca None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:22.530452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:22.536328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d0267-3289-47be-a9a3-fbad02aa48af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:22.539203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d0267-3289-47be-a9a3-fbad02aa48af None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:22.573270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe3ce0-999c-452d-a29d-5ec375a4c3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:22.573907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3ce0-999c-452d-a29d-5ec375a4c3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:22.574195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3ce0-999c-452d-a29d-5ec375a4c3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:22.574478 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3ce0-999c-452d-a29d-5ec375a4c3b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:22.575223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe3ce0-999c-452d-a29d-5ec375a4c3b8 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f, user.id=ea0bb7d073ca4a9588a262eed95c091c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:22.575539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe3ce0-999c-452d-a29d-5ec375a4c3b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:22.577038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe3ce0-999c-452d-a29d-5ec375a4c3b8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:22.584232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 47/93] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:22 2022] GET /identity/v3/role_assignments?user.id=ea0bb7d073ca4a9588a262eed95c091c&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=56228137a4444ef9b7e688d04abd00fd => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:22.587266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe3ce0-999c-452d-a29d-5ec375a4c3b8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:22.687589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 47/94] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:22.694596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d0267-3289-47be-a9a3-fbad02aa48af None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:22.724032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe3ce0-999c-452d-a29d-5ec375a4c3b8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:22.763696 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aadcf-a865-4103-b1e7-1684f6ec296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:22.764488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aadcf-a865-4103-b1e7-1684f6ec296d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:22.764893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aadcf-a865-4103-b1e7-1684f6ec296d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:22.765264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aadcf-a865-4103-b1e7-1684f6ec296d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:22.766108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4aadcf-a865-4103-b1e7-1684f6ec296d None admin] RBAC: Adding query filter params (role.id=f196d84ade534597912f4ce3ca3f36ee, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f, user.id=735fc3fffec44536b08892ae5de87f8a) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:22.766551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4aadcf-a865-4103-b1e7-1684f6ec296d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:22.768136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4aadcf-a865-4103-b1e7-1684f6ec296d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:22.772097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:22.775865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 48/95] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:22 2022] GET /identity/v3/role_assignments?user.id=735fc3fffec44536b08892ae5de87f8a&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=f196d84ade534597912f4ce3ca3f36ee => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:22.835687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:22.841291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d0267-3289-47be-a9a3-fbad02aa48af None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:22.892789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564837dd-0b55-426f-ad71-99b41d0b14a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:22.893492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564837dd-0b55-426f-ad71-99b41d0b14a1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:22.893779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564837dd-0b55-426f-ad71-99b41d0b14a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:22.894056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564837dd-0b55-426f-ad71-99b41d0b14a1 None admin] PATH_INFO: `/v3/projects/32ddea9f4f18413faf7befcdfb4d75b8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:22.901467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564837dd-0b55-426f-ad71-99b41d0b14a1 None admin] RBAC: Authorizing `identity:get_project(project_id=32ddea9f4f18413faf7befcdfb4d75b8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:22.902994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564837dd-0b55-426f-ad71-99b41d0b14a1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:22.904854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 48/96] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:22 2022] GET /identity/v3/projects/32ddea9f4f18413faf7befcdfb4d75b8 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:22.911223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aadcf-a865-4103-b1e7-1684f6ec296d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:23.040968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aadcf-a865-4103-b1e7-1684f6ec296d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:23.083539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44da77b-80f6-4d1a-be99-010d97eca260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:23.084163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44da77b-80f6-4d1a-be99-010d97eca260 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:23.084445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44da77b-80f6-4d1a-be99-010d97eca260 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:23.084756 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44da77b-80f6-4d1a-be99-010d97eca260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:23.085494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44da77b-80f6-4d1a-be99-010d97eca260 None admin] RBAC: Adding query filter params (role.id=6bf2c10dc09a4e9087fd12312566376f, scope.project.id=32ddea9f4f18413faf7befcdfb4d75b8, user.id=735fc3fffec44536b08892ae5de87f8a) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:23.085807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44da77b-80f6-4d1a-be99-010d97eca260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:23.087271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44da77b-80f6-4d1a-be99-010d97eca260 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:23.093580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 49/97] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:22 2022] GET /identity/v3/role_assignments?user.id=735fc3fffec44536b08892ae5de87f8a&scope.project.id=32ddea9f4f18413faf7befcdfb4d75b8&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:25.154580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c3648-da20-466b-809e-a8f595fa15eb None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.155562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c3648-da20-466b-809e-a8f595fa15eb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.156054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c3648-da20-466b-809e-a8f595fa15eb None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.157778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 49/98] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:25.163963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9ddcd-3225-4757-81f8-dac892c60860 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.164934 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9ddcd-3225-4757-81f8-dac892c60860 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.165422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9ddcd-3225-4757-81f8-dac892c60860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.193708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0de9ddcd-3225-4757-81f8-dac892c60860 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:25.195385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0de9ddcd-3225-4757-81f8-dac892c60860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:25.216264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31984487-6356-4dfe-93bb-9fc9d893a4d9 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.216958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31984487-6356-4dfe-93bb-9fc9d893a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.217484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31984487-6356-4dfe-93bb-9fc9d893a4d9 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.219298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 50/99] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:25.224403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7494b-2ef4-45ce-834a-4d3bc5b985dd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.224973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7494b-2ef4-45ce-834a-4d3bc5b985dd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.225478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7494b-2ef4-45ce-834a-4d3bc5b985dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.258608 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c5b7494b-2ef4-45ce-834a-4d3bc5b985dd None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:25.260189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c5b7494b-2ef4-45ce-834a-4d3bc5b985dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:25.275548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:25.290138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 50/100] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:25.372084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 51/101] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:25.532782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd76e1-9a31-432f-a05d-3591c3834c6d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.533087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd76e1-9a31-432f-a05d-3591c3834c6d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.533351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd76e1-9a31-432f-a05d-3591c3834c6d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.534860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 51/102] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:25.545957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa795-878d-44d0-b1a4-e735a529226c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.546250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa795-878d-44d0-b1a4-e735a529226c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.546535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defa795-878d-44d0-b1a4-e735a529226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.554081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637d3c7-0a26-4cc1-94ea-e1c874cb46f2 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.554392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637d3c7-0a26-4cc1-94ea-e1c874cb46f2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.554791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637d3c7-0a26-4cc1-94ea-e1c874cb46f2 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.556255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 52/103] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:25.566462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212066f-59a4-4183-872d-0cd7e65d169f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.566747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212066f-59a4-4183-872d-0cd7e65d169f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.567141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212066f-59a4-4183-872d-0cd7e65d169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.596504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6defa795-878d-44d0-b1a4-e735a529226c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:25.598348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6defa795-878d-44d0-b1a4-e735a529226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:25.613482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c212066f-59a4-4183-872d-0cd7e65d169f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:25.614673 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c212066f-59a4-4183-872d-0cd7e65d169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:25.742791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 52/104] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:25.743521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 53/105] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:25.743657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defa795-878d-44d0-b1a4-e735a529226c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:25.763106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212066f-59a4-4183-872d-0cd7e65d169f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:25.777091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:25.872850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212066f-59a4-4183-872d-0cd7e65d169f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:25.895411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defa795-878d-44d0-b1a4-e735a529226c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:25.900291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:25.912362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd8d9d-0630-4f0e-a221-69f3d1143549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:25.913365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8d9d-0630-4f0e-a221-69f3d1143549 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.913852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8d9d-0630-4f0e-a221-69f3d1143549 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.914329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8d9d-0630-4f0e-a221-69f3d1143549 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.926087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd8d9d-0630-4f0e-a221-69f3d1143549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-73cd8d9d-0630-4f0e-a221-69f3d1143549 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:25.931303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:25.932158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:25.932991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:25.935512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 54/106] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:25.938077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2352df-25b6-4437-ad3e-a295aa84adfd None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.938588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2352df-25b6-4437-ad3e-a295aa84adfd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.939092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2352df-25b6-4437-ad3e-a295aa84adfd None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.941636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 55/107] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:25.944932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2352df-25b6-4437-ad3e-a295aa84adfd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:25.945149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1c0ee-b757-41b7-af10-921b5f499d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:25.945785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c0ee-b757-41b7-af10-921b5f499d66 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.946079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c0ee-b757-41b7-af10-921b5f499d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.946361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c0ee-b757-41b7-af10-921b5f499d66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.947678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1c0ee-b757-41b7-af10-921b5f499d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:25.949242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1c0ee-b757-41b7-af10-921b5f499d66 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:25.951323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 53/108] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:25.952435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1a42-7f0c-468c-80e4-8d08356186c3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:25.952762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1a42-7f0c-468c-80e4-8d08356186c3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:25.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1a42-7f0c-468c-80e4-8d08356186c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:25.974690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d0ca1a42-7f0c-468c-80e4-8d08356186c3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:25.975892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d0ca1a42-7f0c-468c-80e4-8d08356186c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:26.066190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2352df-25b6-4437-ad3e-a295aa84adfd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:26.092068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 54/109] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:26.093005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1a42-7f0c-468c-80e4-8d08356186c3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:26.105450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd09a69-4e12-4781-bb53-2ba18b08c697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:26.106404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd09a69-4e12-4781-bb53-2ba18b08c697 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.106891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd09a69-4e12-4781-bb53-2ba18b08c697 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.107372 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd09a69-4e12-4781-bb53-2ba18b08c697 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.108275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd09a69-4e12-4781-bb53-2ba18b08c697 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:26.108803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd09a69-4e12-4781-bb53-2ba18b08c697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:26.110482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd09a69-4e12-4781-bb53-2ba18b08c697 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:26.120891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 56/110] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:26.126454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd09a69-4e12-4781-bb53-2ba18b08c697 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:26.138565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:26.176844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:26.217297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1a42-7f0c-468c-80e4-8d08356186c3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:26.233753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd09a69-4e12-4781-bb53-2ba18b08c697 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:26.255385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0935b-30e8-4f87-9915-4ec1d55e2178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:26.256003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0935b-30e8-4f87-9915-4ec1d55e2178 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.256284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0935b-30e8-4f87-9915-4ec1d55e2178 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.256598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0935b-30e8-4f87-9915-4ec1d55e2178 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.257661 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0935b-30e8-4f87-9915-4ec1d55e2178 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:26.259104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0935b-30e8-4f87-9915-4ec1d55e2178 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:26.270967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cadef-1ccd-432c-8b70-9e0b84292548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:26.271608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cadef-1ccd-432c-8b70-9e0b84292548 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.271894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cadef-1ccd-432c-8b70-9e0b84292548 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.272174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cadef-1ccd-432c-8b70-9e0b84292548 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.286189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cadef-1ccd-432c-8b70-9e0b84292548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:26.296815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 55/111] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:50:26 2022] POST /identity/v3/projects => generated 302 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:50:26.296815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0935b-30e8-4f87-9915-4ec1d55e2178 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0a2cadef-1ccd-432c-8b70-9e0b84292548 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:26.297369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:26.298231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 57/112] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:26.299065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cadef-1ccd-432c-8b70-9e0b84292548 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:26.404730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:26.421996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cadef-1ccd-432c-8b70-9e0b84292548 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:26.430778 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:26.435990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0935b-30e8-4f87-9915-4ec1d55e2178 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:26.462151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521d957-6496-4d60-bf0e-978d8cf6007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:26.462798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521d957-6496-4d60-bf0e-978d8cf6007a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.463086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521d957-6496-4d60-bf0e-978d8cf6007a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.463511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521d957-6496-4d60-bf0e-978d8cf6007a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.474205 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521d957-6496-4d60-bf0e-978d8cf6007a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:26.476996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af96c86-e8f7-4214-af37-b13ebba09d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:26.477642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af96c86-e8f7-4214-af37-b13ebba09d24 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.477928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af96c86-e8f7-4214-af37-b13ebba09d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.478208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af96c86-e8f7-4214-af37-b13ebba09d24 None admin] PATH_INFO: `/v3/users/735fc3fffec44536b08892ae5de87f8a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d521d957-6496-4d60-bf0e-978d8cf6007a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:26.478941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:26.479788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:26.480626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:26.481223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af96c86-e8f7-4214-af37-b13ebba09d24 None admin] RBAC: Authorizing `identity:get_user(user_id=735fc3fffec44536b08892ae5de87f8a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:26.481290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 58/113] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:50:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:26.481856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a5b79-17c7-41fa-9d22-8adf38bd4323 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.481976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af96c86-e8f7-4214-af37-b13ebba09d24 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:26.482049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a5b79-17c7-41fa-9d22-8adf38bd4323 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.483055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a5b79-17c7-41fa-9d22-8adf38bd4323 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.484133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 59/114] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:26.484242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 56/115] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:26 2022] GET /identity/v3/users/735fc3fffec44536b08892ae5de87f8a => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:26.484329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a5b79-17c7-41fa-9d22-8adf38bd4323 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:26.485741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af96c86-e8f7-4214-af37-b13ebba09d24 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:26.594937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af96c86-e8f7-4214-af37-b13ebba09d24 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:26.601017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a5b79-17c7-41fa-9d22-8adf38bd4323 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:26.632149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983214e-2753-4a63-916a-eaa3ae98bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:26.633221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983214e-2753-4a63-916a-eaa3ae98bf6b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.633671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983214e-2753-4a63-916a-eaa3ae98bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.633959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983214e-2753-4a63-916a-eaa3ae98bf6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.638911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53534b5-b018-4ef9-bcce-c40b357b05ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:26.639510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53534b5-b018-4ef9-bcce-c40b357b05ec None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.639852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53534b5-b018-4ef9-bcce-c40b357b05ec None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.640079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53534b5-b018-4ef9-bcce-c40b357b05ec None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.640796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53534b5-b018-4ef9-bcce-c40b357b05ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:26.641116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53534b5-b018-4ef9-bcce-c40b357b05ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:26.642494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53534b5-b018-4ef9-bcce-c40b357b05ec None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:26.644946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983214e-2753-4a63-916a-eaa3ae98bf6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6983214e-2753-4a63-916a-eaa3ae98bf6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:26.650209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:26.651144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:26.651921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:26.652544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 60/116] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:26.652613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 57/117] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:26.652691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53534b5-b018-4ef9-bcce-c40b357b05ec None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:26.652759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328b9a5-5785-4bd8-87ef-696a2d30aa31 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.652759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328b9a5-5785-4bd8-87ef-696a2d30aa31 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.653045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328b9a5-5785-4bd8-87ef-696a2d30aa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.663720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:26.676730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a328b9a5-5785-4bd8-87ef-696a2d30aa31 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:26.677948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a328b9a5-5785-4bd8-87ef-696a2d30aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:26.692297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:26.767948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 58/118] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:26.773486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328b9a5-5785-4bd8-87ef-696a2d30aa31 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:26.773813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53534b5-b018-4ef9-bcce-c40b357b05ec None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:26.813510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f383763-40f8-4dbc-900b-8981247c23de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:26.814429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f383763-40f8-4dbc-900b-8981247c23de None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.814735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f383763-40f8-4dbc-900b-8981247c23de None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.815631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f383763-40f8-4dbc-900b-8981247c23de None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.816384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f383763-40f8-4dbc-900b-8981247c23de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:26.816783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f383763-40f8-4dbc-900b-8981247c23de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:26.818332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f383763-40f8-4dbc-900b-8981247c23de None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:26.827418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 61/119] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:50:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:26.828397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f383763-40f8-4dbc-900b-8981247c23de None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:26.909959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328b9a5-5785-4bd8-87ef-696a2d30aa31 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:26.930154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:26.942973 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f383763-40f8-4dbc-900b-8981247c23de None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:26.954367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983f23e-6493-4bda-af86-7b288be8031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:26.955745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983f23e-6493-4bda-af86-7b288be8031f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.956197 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983f23e-6493-4bda-af86-7b288be8031f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.957031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983f23e-6493-4bda-af86-7b288be8031f None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.958593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983f23e-6493-4bda-af86-7b288be8031f None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:26.960809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983f23e-6493-4bda-af86-7b288be8031f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:26.968162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 59/120] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:26 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:26.968162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983f23e-6493-4bda-af86-7b288be8031f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:26.972822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:26.989863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db9fb1-1251-41d6-b878-b070d6f04e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:26.991122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db9fb1-1251-41d6-b878-b070d6f04e8b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:26.991356 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db9fb1-1251-41d6-b878-b070d6f04e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:26.991772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db9fb1-1251-41d6-b878-b070d6f04e8b None admin] PATH_INFO: `/v3/users/ea0bb7d073ca4a9588a262eed95c091c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:26.993060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db9fb1-1251-41d6-b878-b070d6f04e8b None admin] RBAC: Authorizing `identity:get_user(user_id=ea0bb7d073ca4a9588a262eed95c091c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:26.994749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db9fb1-1251-41d6-b878-b070d6f04e8b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:26.996702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 62/121] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:26 2022] GET /identity/v3/users/ea0bb7d073ca4a9588a262eed95c091c => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:27.001959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db9fb1-1251-41d6-b878-b070d6f04e8b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:27.093365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983f23e-6493-4bda-af86-7b288be8031f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:27.109644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db9fb1-1251-41d6-b878-b070d6f04e8b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:27.130266 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8f91-be53-4248-aa8f-3c3c5427d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:27.130892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8f91-be53-4248-aa8f-3c3c5427d870 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:27.131187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8f91-be53-4248-aa8f-3c3c5427d870 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:27.131469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8f91-be53-4248-aa8f-3c3c5427d870 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:27.132142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8f91-be53-4248-aa8f-3c3c5427d870 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:27.132475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8f91-be53-4248-aa8f-3c3c5427d870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:27.133988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8f91-be53-4248-aa8f-3c3c5427d870 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:27.142405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 60/122] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:27.143022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8f91-be53-4248-aa8f-3c3c5427d870 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:27.152081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da619179-f5c5-45b2-8973-27ac8441741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:27.153334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da619179-f5c5-45b2-8973-27ac8441741f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:27.153629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da619179-f5c5-45b2-8973-27ac8441741f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:27.153911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da619179-f5c5-45b2-8973-27ac8441741f None admin] PATH_INFO: `/v3/users/735fc3fffec44536b08892ae5de87f8a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:27.155406 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da619179-f5c5-45b2-8973-27ac8441741f None admin] RBAC: Authorizing `identity:get_user(user_id=735fc3fffec44536b08892ae5de87f8a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:27.157196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da619179-f5c5-45b2-8973-27ac8441741f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:27.158922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 63/123] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:26 2022] GET /identity/v3/users/735fc3fffec44536b08892ae5de87f8a => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:27.159547 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da619179-f5c5-45b2-8973-27ac8441741f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:27.190777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:27.211943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:27.254647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8f91-be53-4248-aa8f-3c3c5427d870 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:27.270163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da619179-f5c5-45b2-8973-27ac8441741f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:27.292409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e88061-b476-4f55-8e85-6a56e5020a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:27.293115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e88061-b476-4f55-8e85-6a56e5020a34 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:27.293405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e88061-b476-4f55-8e85-6a56e5020a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:27.293689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e88061-b476-4f55-8e85-6a56e5020a34 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/users/735fc3fffec44536b08892ae5de87f8a/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:27.295669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e88061-b476-4f55-8e85-6a56e5020a34 None admin] RBAC: Authorizing `identity:create_grant(project_id=15ee3b151eae4eaeb717f9ddd26bc41f, user_id=735fc3fffec44536b08892ae5de87f8a, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:27.297162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e88061-b476-4f55-8e85-6a56e5020a34 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:27.307167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c68f0-edbc-4b87-b418-0a487684a40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:27.307823 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c68f0-edbc-4b87-b418-0a487684a40a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:27.308110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c68f0-edbc-4b87-b418-0a487684a40a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:27.308395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c68f0-edbc-4b87-b418-0a487684a40a None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:27.309568 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c68f0-edbc-4b87-b418-0a487684a40a None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:27.311051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c68f0-edbc-4b87-b418-0a487684a40a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:27.316665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 61/124] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:50:27 2022] PUT /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/users/735fc3fffec44536b08892ae5de87f8a/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:27.316665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e88061-b476-4f55-8e85-6a56e5020a34 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:27.316924 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 64/125] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:27 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:27.316924 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c68f0-edbc-4b87-b418-0a487684a40a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:27.449457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e88061-b476-4f55-8e85-6a56e5020a34 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:27.473571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:27.480337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c68f0-edbc-4b87-b418-0a487684a40a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:27.483409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:27.503659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dff142-2d4e-4b9f-a0cc-2985b6d0bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:27.504417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dff142-2d4e-4b9f-a0cc-2985b6d0bbfc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:27.504826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dff142-2d4e-4b9f-a0cc-2985b6d0bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:27.505178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dff142-2d4e-4b9f-a0cc-2985b6d0bbfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:27.519615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dff142-2d4e-4b9f-a0cc-2985b6d0bbfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:27.524524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5615a-d7db-4dc1-9512-e4eb17ee9a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-66dff142-2d4e-4b9f-a0cc-2985b6d0bbfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:27.524871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:27.525920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:27.526893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:27.528117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 62/126] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:27.528275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5615a-d7db-4dc1-9512-e4eb17ee9a47 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:27.528714 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5615a-d7db-4dc1-9512-e4eb17ee9a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:27.529123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5615a-d7db-4dc1-9512-e4eb17ee9a47 None admin] PATH_INFO: `/v3/users/ae648c35da794682a988142b552736a2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:27.529294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dff142-2d4e-4b9f-a0cc-2985b6d0bbfc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:27.551341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5615a-d7db-4dc1-9512-e4eb17ee9a47 None admin] RBAC: Authorizing `identity:get_user(user_id=ae648c35da794682a988142b552736a2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:27.553292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5615a-d7db-4dc1-9512-e4eb17ee9a47 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:27.555447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 65/127] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:27 2022] GET /identity/v3/users/ae648c35da794682a988142b552736a2 => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:27.556721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5615a-d7db-4dc1-9512-e4eb17ee9a47 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:27.635345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dff142-2d4e-4b9f-a0cc-2985b6d0bbfc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:27.680971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3599b2-899f-4567-8ee1-db3829f6b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:27.681631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3599b2-899f-4567-8ee1-db3829f6b5ef None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:27.681927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3599b2-899f-4567-8ee1-db3829f6b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:27.682201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5615a-d7db-4dc1-9512-e4eb17ee9a47 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:27.682304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3599b2-899f-4567-8ee1-db3829f6b5ef None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:27.683393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3599b2-899f-4567-8ee1-db3829f6b5ef None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:27.686272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3599b2-899f-4567-8ee1-db3829f6b5ef None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:27.688147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 63/128] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:27 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:27.693341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3599b2-899f-4567-8ee1-db3829f6b5ef None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:27.744131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ed070-6266-48da-b048-a20d468b3dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:27.744854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ed070-6266-48da-b048-a20d468b3dc0 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:27.745143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ed070-6266-48da-b048-a20d468b3dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:27.745426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ed070-6266-48da-b048-a20d468b3dc0 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/users/ea0bb7d073ca4a9588a262eed95c091c/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:27.747636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ed070-6266-48da-b048-a20d468b3dc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=15ee3b151eae4eaeb717f9ddd26bc41f, user_id=ea0bb7d073ca4a9588a262eed95c091c, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:27.749112 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ed070-6266-48da-b048-a20d468b3dc0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:27.757571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:27.771904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 66/129] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:50:27 2022] PUT /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/users/ea0bb7d073ca4a9588a262eed95c091c/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:27.777142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ed070-6266-48da-b048-a20d468b3dc0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:27.812997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:27.852683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3599b2-899f-4567-8ee1-db3829f6b5ef None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:27.933204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4a9e3-8c7f-464a-9191-6fec2007c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:27.934182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4a9e3-8c7f-464a-9191-6fec2007c591 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:27.934685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4a9e3-8c7f-464a-9191-6fec2007c591 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:27.935156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4a9e3-8c7f-464a-9191-6fec2007c591 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:27.936094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4a9e3-8c7f-464a-9191-6fec2007c591 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:27.940507 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4a9e3-8c7f-464a-9191-6fec2007c591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:27.946185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4a9e3-8c7f-464a-9191-6fec2007c591 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:27.958203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 64/130] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:27.959063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4a9e3-8c7f-464a-9191-6fec2007c591 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:27.961794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ed070-6266-48da-b048-a20d468b3dc0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:28.007516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12044-08ef-4857-9d89-c5a6b06cc1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:28.008035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12044-08ef-4857-9d89-c5a6b06cc1ac None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:28.008326 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12044-08ef-4857-9d89-c5a6b06cc1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:28.008642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c12044-08ef-4857-9d89-c5a6b06cc1ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:28.088278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4a9e3-8c7f-464a-9191-6fec2007c591 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:28.101497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12044-08ef-4857-9d89-c5a6b06cc1ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:28.102862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:28.102993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c12044-08ef-4857-9d89-c5a6b06cc1ac None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:28.118563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:28.127055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b81dd4-e7e7-4281-aabb-0da815206fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:28.128352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b81dd4-e7e7-4281-aabb-0da815206fee None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:28.128661 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b81dd4-e7e7-4281-aabb-0da815206fee None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:28.128942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b81dd4-e7e7-4281-aabb-0da815206fee None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/users/735fc3fffec44536b08892ae5de87f8a/roles/f196d84ade534597912f4ce3ca3f36ee` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:28.131414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b81dd4-e7e7-4281-aabb-0da815206fee None admin] RBAC: Authorizing `identity:create_grant(project_id=15ee3b151eae4eaeb717f9ddd26bc41f, user_id=735fc3fffec44536b08892ae5de87f8a, role_id=f196d84ade534597912f4ce3ca3f36ee)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:28.132911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b81dd4-e7e7-4281-aabb-0da815206fee None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:28.153550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 65/131] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:50:27 2022] PUT /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/users/735fc3fffec44536b08892ae5de87f8a/roles/f196d84ade534597912f4ce3ca3f36ee => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:28.154518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b81dd4-e7e7-4281-aabb-0da815206fee None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:28.214570 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 67/132] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:28.220909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12044-08ef-4857-9d89-c5a6b06cc1ac None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:28.343434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b81dd4-e7e7-4281-aabb-0da815206fee None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:28.348969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c12044-08ef-4857-9d89-c5a6b06cc1ac None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:28.376861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:28.409582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa862aa-5f3e-4e17-81ff-09f8551cad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:28.410614 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673d0c-fa2a-4cd2-816b-d3c5a6d020d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:28.410892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa862aa-5f3e-4e17-81ff-09f8551cad2f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:28.411269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673d0c-fa2a-4cd2-816b-d3c5a6d020d6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:28.411557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673d0c-fa2a-4cd2-816b-d3c5a6d020d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:28.411757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa862aa-5f3e-4e17-81ff-09f8551cad2f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:28.411913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673d0c-fa2a-4cd2-816b-d3c5a6d020d6 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:28.412490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa862aa-5f3e-4e17-81ff-09f8551cad2f None admin] PATH_INFO: `/v3/users/735fc3fffec44536b08892ae5de87f8a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:28.413062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f673d0c-fa2a-4cd2-816b-d3c5a6d020d6 None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:28.414034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa862aa-5f3e-4e17-81ff-09f8551cad2f None admin] RBAC: Authorizing `identity:get_user(user_id=735fc3fffec44536b08892ae5de87f8a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:28.414524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f673d0c-fa2a-4cd2-816b-d3c5a6d020d6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:28.415897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa862aa-5f3e-4e17-81ff-09f8551cad2f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:28.416531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 68/133] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:28 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:28.417645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583de9f2-1afb-4d2c-9b8f-23853b59845b None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:28.420577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583de9f2-1afb-4d2c-9b8f-23853b59845b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:28.420577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583de9f2-1afb-4d2c-9b8f-23853b59845b None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:28.420577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 69/134] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:28.421224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 66/135] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:28 2022] GET /identity/v3/users/735fc3fffec44536b08892ae5de87f8a => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:28.427553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583de9f2-1afb-4d2c-9b8f-23853b59845b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:28.429007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa862aa-5f3e-4e17-81ff-09f8551cad2f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:28.485602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:28.557215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583de9f2-1afb-4d2c-9b8f-23853b59845b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:28.588918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa862aa-5f3e-4e17-81ff-09f8551cad2f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:28.634396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af758903-9e31-4f13-a119-91508134019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:28.634968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af758903-9e31-4f13-a119-91508134019d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:28.635251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af758903-9e31-4f13-a119-91508134019d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:28.635526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af758903-9e31-4f13-a119-91508134019d None admin] PATH_INFO: `/v3/projects/32ddea9f4f18413faf7befcdfb4d75b8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:28.636724 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af758903-9e31-4f13-a119-91508134019d None admin] RBAC: Authorizing `identity:get_project(project_id=32ddea9f4f18413faf7befcdfb4d75b8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:28.638196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af758903-9e31-4f13-a119-91508134019d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:28.642079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 70/136] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:28 2022] GET /identity/v3/projects/32ddea9f4f18413faf7befcdfb4d75b8 => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:28.643287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39532d93-6a8a-4ee6-87d9-4a2c445dbce2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:28.643574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39532d93-6a8a-4ee6-87d9-4a2c445dbce2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:28.644965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971e180-8c82-4fc9-a1dc-fd2b33c4deb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:28.645580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971e180-8c82-4fc9-a1dc-fd2b33c4deb4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:28.645908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971e180-8c82-4fc9-a1dc-fd2b33c4deb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:28.646185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971e180-8c82-4fc9-a1dc-fd2b33c4deb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:28.647149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971e180-8c82-4fc9-a1dc-fd2b33c4deb4 None admin] RBAC: Adding query filter params (role.id=abf1096d1164471f9a47ae942e516329, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f, user.id=ae648c35da794682a988142b552736a2) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:28.647252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971e180-8c82-4fc9-a1dc-fd2b33c4deb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:28.648748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971e180-8c82-4fc9-a1dc-fd2b33c4deb4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:28.650906 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39532d93-6a8a-4ee6-87d9-4a2c445dbce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:28.660115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 67/137] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:28 2022] GET /identity/v3/role_assignments?user.id=ae648c35da794682a988142b552736a2&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=abf1096d1164471f9a47ae942e516329 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:28.660975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971e180-8c82-4fc9-a1dc-fd2b33c4deb4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:28.688561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-39532d93-6a8a-4ee6-87d9-4a2c445dbce2 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:28.689815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-39532d93-6a8a-4ee6-87d9-4a2c445dbce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:28.791967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:28.826238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 71/138] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:28.849748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971e180-8c82-4fc9-a1dc-fd2b33c4deb4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:28.876851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:28.900974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d7871-8cb6-4aee-988f-fb77323621b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:28.901560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7871-8cb6-4aee-988f-fb77323621b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:28.901846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7871-8cb6-4aee-988f-fb77323621b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:28.902126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d7871-8cb6-4aee-988f-fb77323621b1 None admin] PATH_INFO: `/v3/projects/32ddea9f4f18413faf7befcdfb4d75b8/users/735fc3fffec44536b08892ae5de87f8a/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:28.904046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d7871-8cb6-4aee-988f-fb77323621b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=32ddea9f4f18413faf7befcdfb4d75b8, user_id=735fc3fffec44536b08892ae5de87f8a, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:28.905522 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d7871-8cb6-4aee-988f-fb77323621b1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:28.930276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 68/139] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:50:28 2022] PUT /identity/v3/projects/32ddea9f4f18413faf7befcdfb4d75b8/users/735fc3fffec44536b08892ae5de87f8a/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:29.118921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39532d93-6a8a-4ee6-87d9-4a2c445dbce2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:29.239055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39532d93-6a8a-4ee6-87d9-4a2c445dbce2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:29.282600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a193b03-f86a-4f75-a8c8-2b71719ecb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:29.283245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a193b03-f86a-4f75-a8c8-2b71719ecb4c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:29.283529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a193b03-f86a-4f75-a8c8-2b71719ecb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:29.283907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a193b03-f86a-4f75-a8c8-2b71719ecb4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:29.289292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a193b03-f86a-4f75-a8c8-2b71719ecb4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:29.290856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a193b03-f86a-4f75-a8c8-2b71719ecb4c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:29.292928 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 72/140] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:29.298344 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d7871-8cb6-4aee-988f-fb77323621b1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:29.425954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d7871-8cb6-4aee-988f-fb77323621b1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:29.475402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17233a-b888-4ca0-93f5-f2f6456ff16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:29.476073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17233a-b888-4ca0-93f5-f2f6456ff16e None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:29.476365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17233a-b888-4ca0-93f5-f2f6456ff16e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:29.476665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17233a-b888-4ca0-93f5-f2f6456ff16e None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:29.477320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17233a-b888-4ca0-93f5-f2f6456ff16e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:29.478777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17233a-b888-4ca0-93f5-f2f6456ff16e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:29.508158 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 69/141] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:50:29 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:50:29.793760 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941df01-66dd-49ba-99d5-d9a8edc41fda None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:29.793963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941df01-66dd-49ba-99d5-d9a8edc41fda None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:29.794239 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941df01-66dd-49ba-99d5-d9a8edc41fda None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:29.795600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 73/142] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:29.801668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e904b-cd0d-495b-9555-1ea760078b25 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:29.801963 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e904b-cd0d-495b-9555-1ea760078b25 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:29.802250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e904b-cd0d-495b-9555-1ea760078b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:29.821397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-088e904b-cd0d-495b-9555-1ea760078b25 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:29.823913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-088e904b-cd0d-495b-9555-1ea760078b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:29.842026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:29.901344 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 70/143] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:30.183970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941df01-66dd-49ba-99d5-d9a8edc41fda None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:30.245451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:30.314191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941df01-66dd-49ba-99d5-d9a8edc41fda None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:30.353343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb07551-743c-45b3-bd87-d40d0e05f78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:30.354069 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb07551-743c-45b3-bd87-d40d0e05f78e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:30.354407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb07551-743c-45b3-bd87-d40d0e05f78e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:30.354695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb07551-743c-45b3-bd87-d40d0e05f78e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:30.373710 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb07551-743c-45b3-bd87-d40d0e05f78e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-dbb07551-743c-45b3-bd87-d40d0e05f78e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:30.383197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:30.384128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:30.384967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:30.394331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e904b-cd0d-495b-9555-1ea760078b25 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:30.397558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 74/144] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:30.524821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e904b-cd0d-495b-9555-1ea760078b25 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:30.566464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7e2bd-e920-4fe7-ab60-ac24c0f55eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:30.567138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7e2bd-e920-4fe7-ab60-ac24c0f55eea None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:30.567427 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7e2bd-e920-4fe7-ab60-ac24c0f55eea None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:30.567703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7e2bd-e920-4fe7-ab60-ac24c0f55eea None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:30.568388 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7e2bd-e920-4fe7-ab60-ac24c0f55eea None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:30.568719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7e2bd-e920-4fe7-ab60-ac24c0f55eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:30.570126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7e2bd-e920-4fe7-ab60-ac24c0f55eea None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:30.584317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 71/145] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:30.589881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb07551-743c-45b3-bd87-d40d0e05f78e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:30.701547 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb07551-743c-45b3-bd87-d40d0e05f78e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:30.710875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:30.747232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143e793-0cdc-4c58-9c85-5146ea04b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:30.747956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143e793-0cdc-4c58-9c85-5146ea04b572 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:30.748249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143e793-0cdc-4c58-9c85-5146ea04b572 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:30.748577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143e793-0cdc-4c58-9c85-5146ea04b572 None admin] PATH_INFO: `/v3/users/735fc3fffec44536b08892ae5de87f8a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:30.749775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143e793-0cdc-4c58-9c85-5146ea04b572 None admin] RBAC: Authorizing `identity:get_user(user_id=735fc3fffec44536b08892ae5de87f8a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:30.751253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143e793-0cdc-4c58-9c85-5146ea04b572 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:30.753591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 75/146] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:30 2022] GET /identity/v3/users/735fc3fffec44536b08892ae5de87f8a => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:30.759157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7e2bd-e920-4fe7-ab60-ac24c0f55eea None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:30.776922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:30.840371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7991b6-ee67-4395-b27a-0f9070729965 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:30.840688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7991b6-ee67-4395-b27a-0f9070729965 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:30.840968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7991b6-ee67-4395-b27a-0f9070729965 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:30.842630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 76/147] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:30.850600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd0df-385a-4217-905c-3b0e8c031343 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:30.851023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd0df-385a-4217-905c-3b0e8c031343 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:30.851400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd0df-385a-4217-905c-3b0e8c031343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:30.876138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-839dd0df-385a-4217-905c-3b0e8c031343 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:30.878090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-839dd0df-385a-4217-905c-3b0e8c031343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:30.890235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7e2bd-e920-4fe7-ab60-ac24c0f55eea None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:30.929547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53af633-f0f6-451e-84d2-028273f49076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:30.930169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53af633-f0f6-451e-84d2-028273f49076 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:30.930453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53af633-f0f6-451e-84d2-028273f49076 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:30.930731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53af633-f0f6-451e-84d2-028273f49076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:31.005100 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53af633-f0f6-451e-84d2-028273f49076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:31.006593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53af633-f0f6-451e-84d2-028273f49076 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:31.023586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:31.051065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 77/148] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:31.129432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 72/149] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:31.135154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dd0df-385a-4217-905c-3b0e8c031343 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:31.255595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dd0df-385a-4217-905c-3b0e8c031343 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:31.258112 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:31.302179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa47f0-1c07-486d-be5b-8193e3de9325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:31.302753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa47f0-1c07-486d-be5b-8193e3de9325 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:31.303041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa47f0-1c07-486d-be5b-8193e3de9325 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:31.303319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa47f0-1c07-486d-be5b-8193e3de9325 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:31.304493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa47f0-1c07-486d-be5b-8193e3de9325 None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:31.306040 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa47f0-1c07-486d-be5b-8193e3de9325 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:31.307787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 78/150] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:31 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:31.313610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53af633-f0f6-451e-84d2-028273f49076 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:31.433876 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53af633-f0f6-451e-84d2-028273f49076 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:31.451693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:31.480039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505c081-2e34-4250-814b-adacc9ece811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:31.480694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505c081-2e34-4250-814b-adacc9ece811 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:31.480978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505c081-2e34-4250-814b-adacc9ece811 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:31.481254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505c081-2e34-4250-814b-adacc9ece811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:31.482002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505c081-2e34-4250-814b-adacc9ece811 None admin] RBAC: Adding query filter params (role.id=6bf2c10dc09a4e9087fd12312566376f, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f, user.id=735fc3fffec44536b08892ae5de87f8a) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:31.482315 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505c081-2e34-4250-814b-adacc9ece811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:31.483781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505c081-2e34-4250-814b-adacc9ece811 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:31.490256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 73/151] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:31 2022] GET /identity/v3/role_assignments?user.id=735fc3fffec44536b08892ae5de87f8a&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:31.507345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a558eb5-e3cb-4a16-9331-e6fb9c9506d3 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:31.507640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a558eb5-e3cb-4a16-9331-e6fb9c9506d3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:31.507975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a558eb5-e3cb-4a16-9331-e6fb9c9506d3 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:31.509498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 79/152] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:31.514610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1a58c-8db2-4353-abaa-7da8891b35b6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:31.514900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1a58c-8db2-4353-abaa-7da8891b35b6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:31.515180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1a58c-8db2-4353-abaa-7da8891b35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:31.541534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f6f1a58c-8db2-4353-abaa-7da8891b35b6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:31.542743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f6f1a58c-8db2-4353-abaa-7da8891b35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:31.594151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578247a4-c0fc-41a8-b23c-bee50810e3bf None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:31.594379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578247a4-c0fc-41a8-b23c-bee50810e3bf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:31.594637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578247a4-c0fc-41a8-b23c-bee50810e3bf None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:31.596797 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 80/153] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:31.605220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5268-4bf9-4469-8dde-7bcec3868ca2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:31.605493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5268-4bf9-4469-8dde-7bcec3868ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:31.605774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5268-4bf9-4469-8dde-7bcec3868ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:31.635443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 74/154] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:31.641500 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-841b5268-4bf9-4469-8dde-7bcec3868ca2 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:31.642733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-841b5268-4bf9-4469-8dde-7bcec3868ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:31.730601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 81/155] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:31.734044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1a58c-8db2-4353-abaa-7da8891b35b6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:31.878604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1a58c-8db2-4353-abaa-7da8891b35b6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:31.893447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:31.928192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a880-cd0f-426e-bf4e-b2a064615aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:31.928869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a880-cd0f-426e-bf4e-b2a064615aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:31.929153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a880-cd0f-426e-bf4e-b2a064615aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:31.929429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a880-cd0f-426e-bf4e-b2a064615aa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:31.945646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0a880-cd0f-426e-bf4e-b2a064615aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-75a0a880-cd0f-426e-bf4e-b2a064615aa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:31.951302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:31.952225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:31.953059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:31.955449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 75/156] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:50:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:31.965582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5268-4bf9-4469-8dde-7bcec3868ca2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:32.088211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5268-4bf9-4469-8dde-7bcec3868ca2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:32.089831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:32.125294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120eb4a-bbe5-421a-abe3-5eddc3ccc08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:32.125932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120eb4a-bbe5-421a-abe3-5eddc3ccc08d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:32.126214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120eb4a-bbe5-421a-abe3-5eddc3ccc08d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:32.126492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120eb4a-bbe5-421a-abe3-5eddc3ccc08d None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:32.127173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120eb4a-bbe5-421a-abe3-5eddc3ccc08d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:32.127515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120eb4a-bbe5-421a-abe3-5eddc3ccc08d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:32.128999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120eb4a-bbe5-421a-abe3-5eddc3ccc08d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:32.138509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 82/157] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:32.144302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a880-cd0f-426e-bf4e-b2a064615aa0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:32.262711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a880-cd0f-426e-bf4e-b2a064615aa0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:32.273115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120eb4a-bbe5-421a-abe3-5eddc3ccc08d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:32.354036 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d133c0d-244c-4f1d-a169-314931e2ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:32.354693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d133c0d-244c-4f1d-a169-314931e2ecde None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:32.354972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d133c0d-244c-4f1d-a169-314931e2ecde None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:32.355250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d133c0d-244c-4f1d-a169-314931e2ecde None admin] PATH_INFO: `/v3/users/ea0bb7d073ca4a9588a262eed95c091c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:32.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d133c0d-244c-4f1d-a169-314931e2ecde None admin] RBAC: Authorizing `identity:get_user(user_id=ea0bb7d073ca4a9588a262eed95c091c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:32.358753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d133c0d-244c-4f1d-a169-314931e2ecde None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:32.360570 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 76/158] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:32 2022] GET /identity/v3/users/ea0bb7d073ca4a9588a262eed95c091c => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:32.366523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d133c0d-244c-4f1d-a169-314931e2ecde None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:32.452736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120eb4a-bbe5-421a-abe3-5eddc3ccc08d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:32.466249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:32.491124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1a331-3fab-4125-a10b-bfb0b11762db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:32.491769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1a331-3fab-4125-a10b-bfb0b11762db None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:32.492051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1a331-3fab-4125-a10b-bfb0b11762db None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:32.492324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1a331-3fab-4125-a10b-bfb0b11762db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:32.503358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1a331-3fab-4125-a10b-bfb0b11762db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a7d1a331-3fab-4125-a10b-bfb0b11762db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:32.508674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:32.509621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:32.510419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 83/159] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:50:32.511060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1a331-3fab-4125-a10b-bfb0b11762db None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:32.537900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:32.550622 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d133c0d-244c-4f1d-a169-314931e2ecde None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:32.616058 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1a331-3fab-4125-a10b-bfb0b11762db None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:32.641192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632548e-678b-486f-8945-7b0c78ea1fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:32.641852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632548e-678b-486f-8945-7b0c78ea1fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:32.642137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632548e-678b-486f-8945-7b0c78ea1fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:32.642419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632548e-678b-486f-8945-7b0c78ea1fc0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:32.652624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efe303-8845-4e04-ad97-4d2a046f105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:32.653302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efe303-8845-4e04-ad97-4d2a046f105c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:32.653593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efe303-8845-4e04-ad97-4d2a046f105c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:32.653873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efe303-8845-4e04-ad97-4d2a046f105c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:32.672086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632548e-678b-486f-8945-7b0c78ea1fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8632548e-678b-486f-8945-7b0c78ea1fc0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:32.689070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:32.692788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 77/160] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:32.695292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632548e-678b-486f-8945-7b0c78ea1fc0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:32.737124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efe303-8845-4e04-ad97-4d2a046f105c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:32.737557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efe303-8845-4e04-ad97-4d2a046f105c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:32.764929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:32.858180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 84/161] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:32.860634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efe303-8845-4e04-ad97-4d2a046f105c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:32.902442 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:32.909761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632548e-678b-486f-8945-7b0c78ea1fc0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:32.980740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea35a45-a4bd-4a51-9ef4-893d0f15ee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:32.981361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35a45-a4bd-4a51-9ef4-893d0f15ee51 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:32.981643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35a45-a4bd-4a51-9ef4-893d0f15ee51 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:32.981919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea35a45-a4bd-4a51-9ef4-893d0f15ee51 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:32.982604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea35a45-a4bd-4a51-9ef4-893d0f15ee51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:32.982907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea35a45-a4bd-4a51-9ef4-893d0f15ee51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:32.984324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea35a45-a4bd-4a51-9ef4-893d0f15ee51 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:33.007988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 78/162] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:50:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:33.008944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea35a45-a4bd-4a51-9ef4-893d0f15ee51 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:33.061251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efe303-8845-4e04-ad97-4d2a046f105c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:33.099042 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d8e44-96b3-4701-91e1-ef0156cbb706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:33.099671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d8e44-96b3-4701-91e1-ef0156cbb706 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:33.099997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d8e44-96b3-4701-91e1-ef0156cbb706 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:33.100277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d8e44-96b3-4701-91e1-ef0156cbb706 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:33.101032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d8e44-96b3-4701-91e1-ef0156cbb706 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:33.101348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d8e44-96b3-4701-91e1-ef0156cbb706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:33.102746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d8e44-96b3-4701-91e1-ef0156cbb706 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:33.111590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 85/163] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:33.112522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d8e44-96b3-4701-91e1-ef0156cbb706 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:33.116735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:33.199077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea35a45-a4bd-4a51-9ef4-893d0f15ee51 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:33.235846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d8e44-96b3-4701-91e1-ef0156cbb706 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:33.260354 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2959-d159-44ee-9b07-9e079b8cd4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:33.260961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2959-d159-44ee-9b07-9e079b8cd4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:33.261243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2959-d159-44ee-9b07-9e079b8cd4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:33.261517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2959-d159-44ee-9b07-9e079b8cd4e2 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:33.263995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa2959-d159-44ee-9b07-9e079b8cd4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:33.265470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa2959-d159-44ee-9b07-9e079b8cd4e2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:33.268607 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 79/164] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:33 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:33.270665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb77bc-744a-4722-bb09-e7f6b302e8c4 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:33.270944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb77bc-744a-4722-bb09-e7f6b302e8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:33.271218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb77bc-744a-4722-bb09-e7f6b302e8c4 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:33.275053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 80/165] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:33.275769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb77bc-744a-4722-bb09-e7f6b302e8c4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:33.303678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012beef-bcd1-4ec8-907a-20e19180f611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:33.304527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012beef-bcd1-4ec8-907a-20e19180f611 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:33.304811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012beef-bcd1-4ec8-907a-20e19180f611 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:33.305087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012beef-bcd1-4ec8-907a-20e19180f611 None admin] PATH_INFO: `/v3/users/735fc3fffec44536b08892ae5de87f8a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:33.308498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012beef-bcd1-4ec8-907a-20e19180f611 None admin] RBAC: Authorizing `identity:get_user(user_id=735fc3fffec44536b08892ae5de87f8a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:33.310678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012beef-bcd1-4ec8-907a-20e19180f611 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:33.312643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 86/166] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:33 2022] GET /identity/v3/users/735fc3fffec44536b08892ae5de87f8a => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:33.313206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012beef-bcd1-4ec8-907a-20e19180f611 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:33.340807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:33.423607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:33.481616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012beef-bcd1-4ec8-907a-20e19180f611 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:33.491042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb77bc-744a-4722-bb09-e7f6b302e8c4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:33.551944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3390f6-036a-4958-83e8-d1744ccc2d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:33.553015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3390f6-036a-4958-83e8-d1744ccc2d06 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:33.553297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3390f6-036a-4958-83e8-d1744ccc2d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:33.553572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3390f6-036a-4958-83e8-d1744ccc2d06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:33.554312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3390f6-036a-4958-83e8-d1744ccc2d06 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f, user.id=ea0bb7d073ca4a9588a262eed95c091c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:33.554621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3390f6-036a-4958-83e8-d1744ccc2d06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:33.556069 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3390f6-036a-4958-83e8-d1744ccc2d06 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:33.559759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e62f40-14d3-41a6-a134-ccb4b0297658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:33.560452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e62f40-14d3-41a6-a134-ccb4b0297658 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:33.560754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e62f40-14d3-41a6-a134-ccb4b0297658 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:33.561024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e62f40-14d3-41a6-a134-ccb4b0297658 None admin] PATH_INFO: `/v3/users/ae648c35da794682a988142b552736a2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:33.562153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e62f40-14d3-41a6-a134-ccb4b0297658 None admin] RBAC: Authorizing `identity:get_user(user_id=ae648c35da794682a988142b552736a2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:33.563642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e62f40-14d3-41a6-a134-ccb4b0297658 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:33.567024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 81/167] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:33 2022] GET /identity/v3/users/ae648c35da794682a988142b552736a2 => generated 289 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:33.568215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ba99a-4639-4728-b8c4-3859e26e86e4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:33.568513 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ba99a-4639-4728-b8c4-3859e26e86e4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:33.568793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ba99a-4639-4728-b8c4-3859e26e86e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:33.574809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 87/168] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:33 2022] GET /identity/v3/role_assignments?user.id=ea0bb7d073ca4a9588a262eed95c091c&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=56228137a4444ef9b7e688d04abd00fd => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:33.575731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3390f6-036a-4958-83e8-d1744ccc2d06 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:33.605499 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9f3ba99a-4639-4728-b8c4-3859e26e86e4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:33.609248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9f3ba99a-4639-4728-b8c4-3859e26e86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:33.715007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3390f6-036a-4958-83e8-d1744ccc2d06 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:33.737359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:33.759361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5f5a9-c1c2-4550-a6f8-956018441775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:33.760002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5f5a9-c1c2-4550-a6f8-956018441775 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:33.760285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5f5a9-c1c2-4550-a6f8-956018441775 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:33.760591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5f5a9-c1c2-4550-a6f8-956018441775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:33.805475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 82/169] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:33.806090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ba99a-4639-4728-b8c4-3859e26e86e4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:33.842293 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5f5a9-c1c2-4550-a6f8-956018441775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:33.843875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5f5a9-c1c2-4550-a6f8-956018441775 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:33.870550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:33.965709 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 88/170] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:33.966874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59967-5146-44fc-9f82-568f9ba08312 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:33.967578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59967-5146-44fc-9f82-568f9ba08312 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:33.967999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59967-5146-44fc-9f82-568f9ba08312 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:33.969685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 89/171] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:33.972568 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59967-5146-44fc-9f82-568f9ba08312 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:33.998446 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:34.033745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ba99a-4639-4728-b8c4-3859e26e86e4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:34.073521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c2f51-0643-4bbf-bfa4-92631ebe66dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:34.074394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2f51-0643-4bbf-bfa4-92631ebe66dc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.074833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2f51-0643-4bbf-bfa4-92631ebe66dc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.075272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2f51-0643-4bbf-bfa4-92631ebe66dc None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.076610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c2f51-0643-4bbf-bfa4-92631ebe66dc None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:34.078437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c2f51-0643-4bbf-bfa4-92631ebe66dc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:34.081190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 83/172] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:33 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:34.082612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bb30f-3d69-45b6-91d7-68d0859691d3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.083099 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bb30f-3d69-45b6-91d7-68d0859691d3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.083563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bb30f-3d69-45b6-91d7-68d0859691d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.102598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59967-5146-44fc-9f82-568f9ba08312 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:34.106334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c70bb30f-3d69-45b6-91d7-68d0859691d3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:34.107783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c70bb30f-3d69-45b6-91d7-68d0859691d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:34.144249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98faed-4953-4061-abc2-09ab9f733b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:34.144895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98faed-4953-4061-abc2-09ab9f733b2f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.145176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98faed-4953-4061-abc2-09ab9f733b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.145444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98faed-4953-4061-abc2-09ab9f733b2f None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.146683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98faed-4953-4061-abc2-09ab9f733b2f None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:34.148135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98faed-4953-4061-abc2-09ab9f733b2f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:34.150018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 90/173] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:33 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:34.150974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb240fb-fd93-4e1c-92f6-bae5528b0613 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.151278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb240fb-fd93-4e1c-92f6-bae5528b0613 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.151554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb240fb-fd93-4e1c-92f6-bae5528b0613 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.156625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 91/174] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:34.156625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80f20-d3be-4c97-8800-1fd591c9ca13 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.156625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80f20-d3be-4c97-8800-1fd591c9ca13 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.156625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80f20-d3be-4c97-8800-1fd591c9ca13 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.156625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 92/175] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:34.160752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f80f20-d3be-4c97-8800-1fd591c9ca13 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:34.186828 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 84/176] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:34.187683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bb30f-3d69-45b6-91d7-68d0859691d3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:34.213039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:34.255054 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:34.273040 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f80f20-d3be-4c97-8800-1fd591c9ca13 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:34.293167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bb30f-3d69-45b6-91d7-68d0859691d3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:34.310096 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288132bb-74ca-4bd7-8174-d155d6723228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:34.310766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288132bb-74ca-4bd7-8174-d155d6723228 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.311053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288132bb-74ca-4bd7-8174-d155d6723228 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.311350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288132bb-74ca-4bd7-8174-d155d6723228 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/users/ae648c35da794682a988142b552736a2/roles/abf1096d1164471f9a47ae942e516329` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.313267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288132bb-74ca-4bd7-8174-d155d6723228 None admin] RBAC: Authorizing `identity:create_grant(project_id=15ee3b151eae4eaeb717f9ddd26bc41f, user_id=ae648c35da794682a988142b552736a2, role_id=abf1096d1164471f9a47ae942e516329)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:34.315278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288132bb-74ca-4bd7-8174-d155d6723228 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:34.329737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 93/177] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:50:34 2022] PUT /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/users/ae648c35da794682a988142b552736a2/roles/abf1096d1164471f9a47ae942e516329 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:34.330792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570fdec-a725-496d-8e70-9e99f91d6c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:34.331417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570fdec-a725-496d-8e70-9e99f91d6c95 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.331702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570fdec-a725-496d-8e70-9e99f91d6c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.331979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570fdec-a725-496d-8e70-9e99f91d6c95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.332761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570fdec-a725-496d-8e70-9e99f91d6c95 None admin] RBAC: Adding query filter params (role.id=f196d84ade534597912f4ce3ca3f36ee, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f, user.id=735fc3fffec44536b08892ae5de87f8a) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:34.333087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570fdec-a725-496d-8e70-9e99f91d6c95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:34.334396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f64804-0074-4f9a-acaf-94e001ed10fa None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.334593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570fdec-a725-496d-8e70-9e99f91d6c95 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:34.335054 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f64804-0074-4f9a-acaf-94e001ed10fa None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.335643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f64804-0074-4f9a-acaf-94e001ed10fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.341463 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 85/178] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:34 2022] GET /identity/v3/role_assignments?user.id=735fc3fffec44536b08892ae5de87f8a&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=f196d84ade534597912f4ce3ca3f36ee => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:34.342876 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9d82d-27df-47c2-9ea9-b045a8670fd6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.343161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9d82d-27df-47c2-9ea9-b045a8670fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.343439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9d82d-27df-47c2-9ea9-b045a8670fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.363259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b7f64804-0074-4f9a-acaf-94e001ed10fa None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:34.364816 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e2a9d82d-27df-47c2-9ea9-b045a8670fd6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:34.365273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b7f64804-0074-4f9a-acaf-94e001ed10fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:34.366268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e2a9d82d-27df-47c2-9ea9-b045a8670fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:34.471696 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 94/179] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:34.473530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f64804-0074-4f9a-acaf-94e001ed10fa None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:34.479858 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 86/180] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:34.484775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9d82d-27df-47c2-9ea9-b045a8670fd6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:34.505702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:34.609729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9d82d-27df-47c2-9ea9-b045a8670fd6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:34.615291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:34.646788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f64804-0074-4f9a-acaf-94e001ed10fa None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:34.657515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1e811-da47-4474-ab21-bc4de78021ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:34.658172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1e811-da47-4474-ab21-bc4de78021ea None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.658488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1e811-da47-4474-ab21-bc4de78021ea None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.658772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1e811-da47-4474-ab21-bc4de78021ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.672313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1e811-da47-4474-ab21-bc4de78021ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-59a1e811-da47-4474-ab21-bc4de78021ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:34.677772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:34.678875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:34.679897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 87/181] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:50:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:34.686743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1e811-da47-4474-ab21-bc4de78021ea None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:34.691365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32b790-ca52-4473-a7d1-638a54768de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:34.692229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32b790-ca52-4473-a7d1-638a54768de1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.692682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32b790-ca52-4473-a7d1-638a54768de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.693283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32b790-ca52-4473-a7d1-638a54768de1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.707848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32b790-ca52-4473-a7d1-638a54768de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5b32b790-ca52-4473-a7d1-638a54768de1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:34.714178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:34.715181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:34.715995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 95/182] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:34.722638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32b790-ca52-4473-a7d1-638a54768de1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:34.854720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:34.883565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32b790-ca52-4473-a7d1-638a54768de1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:34.886468 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1e811-da47-4474-ab21-bc4de78021ea None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:34.920593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff606e00-3131-441f-8027-1b8401b3c969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:34.921288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff606e00-3131-441f-8027-1b8401b3c969 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.921574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff606e00-3131-441f-8027-1b8401b3c969 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.921853 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff606e00-3131-441f-8027-1b8401b3c969 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.922514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff606e00-3131-441f-8027-1b8401b3c969 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:34.922846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff606e00-3131-441f-8027-1b8401b3c969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:34.923424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fb097-b765-4147-bcb6-4b09f594d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:34.924224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fb097-b765-4147-bcb6-4b09f594d3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:34.924352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff606e00-3131-441f-8027-1b8401b3c969 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:34.924799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fb097-b765-4147-bcb6-4b09f594d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:34.925238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fb097-b765-4147-bcb6-4b09f594d3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:34.926061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fb097-b765-4147-bcb6-4b09f594d3d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:34.926512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fb097-b765-4147-bcb6-4b09f594d3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:34.926654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:34.928064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fb097-b765-4147-bcb6-4b09f594d3d5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:34.933308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 96/183] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:34.937898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff606e00-3131-441f-8027-1b8401b3c969 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:34.944961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 88/184] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:34.944961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fb097-b765-4147-bcb6-4b09f594d3d5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:35.053246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff606e00-3131-441f-8027-1b8401b3c969 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:35.056159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fb097-b765-4147-bcb6-4b09f594d3d5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:35.092336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d5d03-af71-4cf9-a5d5-88132e098699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:35.093003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d5d03-af71-4cf9-a5d5-88132e098699 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:35.093294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d5d03-af71-4cf9-a5d5-88132e098699 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:35.093578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d5d03-af71-4cf9-a5d5-88132e098699 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:35.094700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d5d03-af71-4cf9-a5d5-88132e098699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:35.096735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d5d03-af71-4cf9-a5d5-88132e098699 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:35.097769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42608d9-3071-42f4-bdaa-c54fa2337bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:35.098508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 97/185] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:35.098908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42608d9-3071-42f4-bdaa-c54fa2337bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:35.099087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d5d03-af71-4cf9-a5d5-88132e098699 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:35.099179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42608d9-3071-42f4-bdaa-c54fa2337bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:35.099854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42608d9-3071-42f4-bdaa-c54fa2337bc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:35.107858 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:35.112443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42608d9-3071-42f4-bdaa-c54fa2337bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e42608d9-3071-42f4-bdaa-c54fa2337bc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:35.118596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:35.119501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:35.120329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:35.122881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 89/186] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:50:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:35.123683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42608d9-3071-42f4-bdaa-c54fa2337bc3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:35.179526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:35.217615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d5d03-af71-4cf9-a5d5-88132e098699 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:35.238928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42608d9-3071-42f4-bdaa-c54fa2337bc3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:35.254951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feb7ab-5a2a-458d-ba23-cebf0832096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:35.255828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feb7ab-5a2a-458d-ba23-cebf0832096a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:35.256094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feb7ab-5a2a-458d-ba23-cebf0832096a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:35.256367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feb7ab-5a2a-458d-ba23-cebf0832096a None admin] PATH_INFO: `/v3/users/735fc3fffec44536b08892ae5de87f8a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:35.257697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feb7ab-5a2a-458d-ba23-cebf0832096a None admin] RBAC: Authorizing `identity:get_user(user_id=735fc3fffec44536b08892ae5de87f8a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:35.259131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feb7ab-5a2a-458d-ba23-cebf0832096a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:35.260744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 98/187] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:35 2022] GET /identity/v3/users/735fc3fffec44536b08892ae5de87f8a => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:35.261484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feb7ab-5a2a-458d-ba23-cebf0832096a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:35.282662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dad75-e0fd-428d-98d5-c2e9816d9057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:35.283687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dad75-e0fd-428d-98d5-c2e9816d9057 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:35.284186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dad75-e0fd-428d-98d5-c2e9816d9057 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:35.284717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dad75-e0fd-428d-98d5-c2e9816d9057 None admin] PATH_INFO: `/v3/users/1fe7fe37f16845ccb8846616c3e3c715` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:35.298417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dad75-e0fd-428d-98d5-c2e9816d9057 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe7fe37f16845ccb8846616c3e3c715)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:35.300078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dad75-e0fd-428d-98d5-c2e9816d9057 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:35.301962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 90/188] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:35 2022] GET /identity/v3/users/1fe7fe37f16845ccb8846616c3e3c715 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:35.302538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dad75-e0fd-428d-98d5-c2e9816d9057 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:35.363761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:35.379299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feb7ab-5a2a-458d-ba23-cebf0832096a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:35.410589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dad75-e0fd-428d-98d5-c2e9816d9057 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:35.415393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ff89d-f2c8-4bd7-a59d-b8252a13cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:35.416242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ff89d-f2c8-4bd7-a59d-b8252a13cfee None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:35.416752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ff89d-f2c8-4bd7-a59d-b8252a13cfee None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:35.417242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ff89d-f2c8-4bd7-a59d-b8252a13cfee None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:35.418118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ff89d-f2c8-4bd7-a59d-b8252a13cfee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:35.419664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ff89d-f2c8-4bd7-a59d-b8252a13cfee None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:35.431022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:35.449186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ca50b-7eb7-4bfc-bea5-a2a96c8e6e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:35.460701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ca50b-7eb7-4bfc-bea5-a2a96c8e6e8a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:35.460924 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 99/189] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:50:35 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:50:35.461008 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ca50b-7eb7-4bfc-bea5-a2a96c8e6e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:35.461008 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ca50b-7eb7-4bfc-bea5-a2a96c8e6e8a None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:35.461143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ff89d-f2c8-4bd7-a59d-b8252a13cfee None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:35.461219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ca50b-7eb7-4bfc-bea5-a2a96c8e6e8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:35.461219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ca50b-7eb7-4bfc-bea5-a2a96c8e6e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:35.461219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ca50b-7eb7-4bfc-bea5-a2a96c8e6e8a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:35.462674 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 91/190] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:50:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:35.463555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ca50b-7eb7-4bfc-bea5-a2a96c8e6e8a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:35.579246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ca50b-7eb7-4bfc-bea5-a2a96c8e6e8a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:35.599585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:35.618436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ff89d-f2c8-4bd7-a59d-b8252a13cfee None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:35.621511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5eb61-b8f0-41bf-af26-4f6ec14b7170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:35.622211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5eb61-b8f0-41bf-af26-4f6ec14b7170 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:35.622558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5eb61-b8f0-41bf-af26-4f6ec14b7170 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:35.622903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5eb61-b8f0-41bf-af26-4f6ec14b7170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:35.665846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755dd41-0034-4c4f-80a4-1ce2718b3ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:35.666783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755dd41-0034-4c4f-80a4-1ce2718b3ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:35.667246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755dd41-0034-4c4f-80a4-1ce2718b3ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:35.667698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755dd41-0034-4c4f-80a4-1ce2718b3ae6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:35.729267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5eb61-b8f0-41bf-af26-4f6ec14b7170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:35.731094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5eb61-b8f0-41bf-af26-4f6ec14b7170 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:35.758051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:35.777198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755dd41-0034-4c4f-80a4-1ce2718b3ae6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:35.779005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755dd41-0034-4c4f-80a4-1ce2718b3ae6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:35.870065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 92/191] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:35.870945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5eb61-b8f0-41bf-af26-4f6ec14b7170 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:35.896302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:35.916529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 100/192] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:35.917380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755dd41-0034-4c4f-80a4-1ce2718b3ae6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:36.005595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5eb61-b8f0-41bf-af26-4f6ec14b7170 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:36.028128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:36.040159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755dd41-0034-4c4f-80a4-1ce2718b3ae6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:36.055919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482ebed-5dcd-4fd3-b03e-efe5015f8be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:36.056598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482ebed-5dcd-4fd3-b03e-efe5015f8be4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:36.056881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482ebed-5dcd-4fd3-b03e-efe5015f8be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:36.057152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482ebed-5dcd-4fd3-b03e-efe5015f8be4 None admin] PATH_INFO: `/v3/users/1fe7fe37f16845ccb8846616c3e3c715` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:36.058708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482ebed-5dcd-4fd3-b03e-efe5015f8be4 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe7fe37f16845ccb8846616c3e3c715)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:36.059821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482ebed-5dcd-4fd3-b03e-efe5015f8be4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:36.061814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 93/193] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:35 2022] GET /identity/v3/users/1fe7fe37f16845ccb8846616c3e3c715 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:36.062613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482ebed-5dcd-4fd3-b03e-efe5015f8be4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:36.085639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9209-95bd-44d6-9f02-0b595a931227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:36.086655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9209-95bd-44d6-9f02-0b595a931227 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:36.087137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9209-95bd-44d6-9f02-0b595a931227 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:36.087629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9209-95bd-44d6-9f02-0b595a931227 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:36.089012 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b9209-95bd-44d6-9f02-0b595a931227 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:36.090692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b9209-95bd-44d6-9f02-0b595a931227 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:36.092980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 101/194] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:35 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:36.094056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9209-95bd-44d6-9f02-0b595a931227 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:36.201577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9209-95bd-44d6-9f02-0b595a931227 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:36.238578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683c34c-6ad8-48fd-a009-dcb619ceb00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:36.239597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683c34c-6ad8-48fd-a009-dcb619ceb00f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:36.240110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683c34c-6ad8-48fd-a009-dcb619ceb00f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:36.240619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683c34c-6ad8-48fd-a009-dcb619ceb00f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:36.254539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:36.268829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482ebed-5dcd-4fd3-b03e-efe5015f8be4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:36.270762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:36.323779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683c34c-6ad8-48fd-a009-dcb619ceb00f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:36.325304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683c34c-6ad8-48fd-a009-dcb619ceb00f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:36.338299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2685873-b340-43d1-89c1-c684c38bc480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:36.339058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2685873-b340-43d1-89c1-c684c38bc480 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:36.339735 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2685873-b340-43d1-89c1-c684c38bc480 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:36.340097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2685873-b340-43d1-89c1-c684c38bc480 None admin] PATH_INFO: `/v3/projects/32ddea9f4f18413faf7befcdfb4d75b8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:36.341445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2685873-b340-43d1-89c1-c684c38bc480 None admin] RBAC: Authorizing `identity:get_project(project_id=32ddea9f4f18413faf7befcdfb4d75b8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:36.342900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2685873-b340-43d1-89c1-c684c38bc480 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:36.344856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 94/195] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:36 2022] GET /identity/v3/projects/32ddea9f4f18413faf7befcdfb4d75b8 => generated 312 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:36.345628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2685873-b340-43d1-89c1-c684c38bc480 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:36.510562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2685873-b340-43d1-89c1-c684c38bc480 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:36.527560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 102/196] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:36.528193 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683c34c-6ad8-48fd-a009-dcb619ceb00f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:36.561440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293fa2e-56ed-414e-bff9-d10903fd4067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:36.564139 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293fa2e-56ed-414e-bff9-d10903fd4067 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:36.564761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293fa2e-56ed-414e-bff9-d10903fd4067 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:36.565240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293fa2e-56ed-414e-bff9-d10903fd4067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:36.567334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293fa2e-56ed-414e-bff9-d10903fd4067 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=b872016c0ae541aab80d335607224572, user.id=1fe7fe37f16845ccb8846616c3e3c715) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:36.568754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293fa2e-56ed-414e-bff9-d10903fd4067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:36.570440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293fa2e-56ed-414e-bff9-d10903fd4067 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:36.585365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 95/197] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:36 2022] GET /identity/v3/role_assignments?user.id=1fe7fe37f16845ccb8846616c3e3c715&scope.project.id=b872016c0ae541aab80d335607224572&role.id=56228137a4444ef9b7e688d04abd00fd => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:36.586527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293fa2e-56ed-414e-bff9-d10903fd4067 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:36.623422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:36.637796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:36.685303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683c34c-6ad8-48fd-a009-dcb619ceb00f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:36.727080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0fc8e-b6cb-44f3-b327-f4d217d0ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:36.728078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0fc8e-b6cb-44f3-b327-f4d217d0ace9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:36.728589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0fc8e-b6cb-44f3-b327-f4d217d0ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:36.729065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0fc8e-b6cb-44f3-b327-f4d217d0ace9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:36.730340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0fc8e-b6cb-44f3-b327-f4d217d0ace9 None admin] RBAC: Adding query filter params (role.id=6bf2c10dc09a4e9087fd12312566376f, scope.project.id=32ddea9f4f18413faf7befcdfb4d75b8, user.id=735fc3fffec44536b08892ae5de87f8a) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:36.730908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0fc8e-b6cb-44f3-b327-f4d217d0ace9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:36.732911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0fc8e-b6cb-44f3-b327-f4d217d0ace9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:36.742729 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 103/198] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:36 2022] GET /identity/v3/role_assignments?user.id=735fc3fffec44536b08892ae5de87f8a&scope.project.id=32ddea9f4f18413faf7befcdfb4d75b8&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:36.744606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13643c-b90b-4b5a-85b9-1cf4d0158a30 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:36.745124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13643c-b90b-4b5a-85b9-1cf4d0158a30 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:36.745597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13643c-b90b-4b5a-85b9-1cf4d0158a30 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:36.748319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 104/199] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:36.752364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3441-758b-4de0-b258-1bba7c9be70a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:36.752944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3441-758b-4de0-b258-1bba7c9be70a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:36.753427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3441-758b-4de0-b258-1bba7c9be70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:36.775086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-527a3441-758b-4de0-b258-1bba7c9be70a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:36.777365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-527a3441-758b-4de0-b258-1bba7c9be70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:36.810552 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293fa2e-56ed-414e-bff9-d10903fd4067 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:36.873319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 105/200] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:36.879005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321dc30-d615-4139-9685-e661990ee54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:36.880027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321dc30-d615-4139-9685-e661990ee54c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:36.880533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321dc30-d615-4139-9685-e661990ee54c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:36.881008 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321dc30-d615-4139-9685-e661990ee54c None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:36.882441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321dc30-d615-4139-9685-e661990ee54c None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:36.884221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321dc30-d615-4139-9685-e661990ee54c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:36.886238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 96/201] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:36 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:36.892315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a3441-758b-4de0-b258-1bba7c9be70a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:36.977536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:37.037663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a3441-758b-4de0-b258-1bba7c9be70a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:37.078725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e2f62-11a0-4269-a6cd-436a007cd4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:37.079267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e2f62-11a0-4269-a6cd-436a007cd4fc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:37.079548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e2f62-11a0-4269-a6cd-436a007cd4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:37.079822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e2f62-11a0-4269-a6cd-436a007cd4fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:37.081176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e2f62-11a0-4269-a6cd-436a007cd4fc None admin] RBAC: Adding query filter params (role.id=f196d84ade534597912f4ce3ca3f36ee, scope.project.id=b872016c0ae541aab80d335607224572, user.id=1fe7fe37f16845ccb8846616c3e3c715) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:37.081492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e2f62-11a0-4269-a6cd-436a007cd4fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:37.083021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e2f62-11a0-4269-a6cd-436a007cd4fc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:37.093551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 106/202] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:36 2022] GET /identity/v3/role_assignments?user.id=1fe7fe37f16845ccb8846616c3e3c715&scope.project.id=b872016c0ae541aab80d335607224572&role.id=f196d84ade534597912f4ce3ca3f36ee => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:37.247324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321dc30-d615-4139-9685-e661990ee54c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:37.359316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:37.381677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321dc30-d615-4139-9685-e661990ee54c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:37.421926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d1dd5-3483-4159-bd51-195df948e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:37.422746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d1dd5-3483-4159-bd51-195df948e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:37.423082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d1dd5-3483-4159-bd51-195df948e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:37.423355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d1dd5-3483-4159-bd51-195df948e2a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:37.437637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d1dd5-3483-4159-bd51-195df948e2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a42d1dd5-3483-4159-bd51-195df948e2a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:37.443010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:37.443896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:37.444744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 97/203] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:37.451972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e2f62-11a0-4269-a6cd-436a007cd4fc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:37.595264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e2f62-11a0-4269-a6cd-436a007cd4fc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:37.618799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:37.645378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e4de-ac53-4ca9-ad19-fbfe868231a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:37.646001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e4de-ac53-4ca9-ad19-fbfe868231a6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:37.646285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e4de-ac53-4ca9-ad19-fbfe868231a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:37.646559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5e4de-ac53-4ca9-ad19-fbfe868231a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:37.647232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5e4de-ac53-4ca9-ad19-fbfe868231a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:37.647539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5e4de-ac53-4ca9-ad19-fbfe868231a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:37.648941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5e4de-ac53-4ca9-ad19-fbfe868231a6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:37.660317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 107/204] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:37.666134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d1dd5-3483-4159-bd51-195df948e2a6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:37.891778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d1dd5-3483-4159-bd51-195df948e2a6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:37.953417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dc762-9c86-476d-b014-b45c0440ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:37.954067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dc762-9c86-476d-b014-b45c0440ef85 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:37.954348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dc762-9c86-476d-b014-b45c0440ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:37.954623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dc762-9c86-476d-b014-b45c0440ef85 None admin] PATH_INFO: `/v3/users/ae648c35da794682a988142b552736a2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:37.957552 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dc762-9c86-476d-b014-b45c0440ef85 None admin] RBAC: Authorizing `identity:get_user(user_id=ae648c35da794682a988142b552736a2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:37.959003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dc762-9c86-476d-b014-b45c0440ef85 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:37.960961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 98/205] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:37 2022] GET /identity/v3/users/ae648c35da794682a988142b552736a2 => generated 289 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:37.969593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e4de-ac53-4ca9-ad19-fbfe868231a6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:38.100243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d537c-3170-417c-91d9-3fe76c262dba None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:38.100651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d537c-3170-417c-91d9-3fe76c262dba None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:38.100829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d537c-3170-417c-91d9-3fe76c262dba None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:38.102576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 99/206] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:38.107804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82f8ea-6c6d-45e5-b344-ac380ff841d6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:38.108081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82f8ea-6c6d-45e5-b344-ac380ff841d6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:38.108355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82f8ea-6c6d-45e5-b344-ac380ff841d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:38.128540 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5e4de-ac53-4ca9-ad19-fbfe868231a6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:38.146042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5b82f8ea-6c6d-45e5-b344-ac380ff841d6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:38.147348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5b82f8ea-6c6d-45e5-b344-ac380ff841d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:38.163940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd050c49-95b4-4e7d-86a3-fbe325ac1d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:38.164611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd050c49-95b4-4e7d-86a3-fbe325ac1d04 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:38.164906 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd050c49-95b4-4e7d-86a3-fbe325ac1d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:38.165182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd050c49-95b4-4e7d-86a3-fbe325ac1d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:38.168270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:38.225227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:38.246803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd050c49-95b4-4e7d-86a3-fbe325ac1d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:38.248623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd050c49-95b4-4e7d-86a3-fbe325ac1d04 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:38.265022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 100/207] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:38.273785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d88ddf-75b7-4bd2-bc2f-60d864b3ab36 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:38.276504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d88ddf-75b7-4bd2-bc2f-60d864b3ab36 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:38.276504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d88ddf-75b7-4bd2-bc2f-60d864b3ab36 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:38.276504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 101/208] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:38.280892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74bb4d-69b8-4c79-b1e8-a6284893f32b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:38.281178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74bb4d-69b8-4c79-b1e8-a6284893f32b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:38.281458 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74bb4d-69b8-4c79-b1e8-a6284893f32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:38.300990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-af74bb4d-69b8-4c79-b1e8-a6284893f32b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:38.302304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-af74bb4d-69b8-4c79-b1e8-a6284893f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:38.406886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 102/209] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:38.442164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 108/210] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:38.448217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74bb4d-69b8-4c79-b1e8-a6284893f32b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:38.531726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:38.558504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74bb4d-69b8-4c79-b1e8-a6284893f32b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:38.599939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a9a70-c76c-4bf8-a363-4dbcf7531c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:38.600966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9a70-c76c-4bf8-a363-4dbcf7531c98 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:38.601537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9a70-c76c-4bf8-a363-4dbcf7531c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:38.602065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a9a70-c76c-4bf8-a363-4dbcf7531c98 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:38.605159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a9a70-c76c-4bf8-a363-4dbcf7531c98 None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:38.606861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a9a70-c76c-4bf8-a363-4dbcf7531c98 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:38.608799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 103/211] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:38 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:38.615382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd050c49-95b4-4e7d-86a3-fbe325ac1d04 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:38.622247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a9a70-c76c-4bf8-a363-4dbcf7531c98 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:38.731254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a9a70-c76c-4bf8-a363-4dbcf7531c98 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:38.757514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:38.774978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9bd66-cb36-4e97-b059-f1048ef59955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:38.776110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9bd66-cb36-4e97-b059-f1048ef59955 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:38.776818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9bd66-cb36-4e97-b059-f1048ef59955 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:38.777533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9bd66-cb36-4e97-b059-f1048ef59955 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:38.785140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd050c49-95b4-4e7d-86a3-fbe325ac1d04 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:38.796107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9bd66-cb36-4e97-b059-f1048ef59955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b5b9bd66-cb36-4e97-b059-f1048ef59955 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:38.805176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:38.806116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:38.806919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:38.809690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 104/212] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:50:38.815613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9bd66-cb36-4e97-b059-f1048ef59955 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:38.816932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:38.833580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f391d3-a5e7-4344-ab5b-2e78c0b6411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:38.834463 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f391d3-a5e7-4344-ab5b-2e78c0b6411c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:38.834751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f391d3-a5e7-4344-ab5b-2e78c0b6411c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:38.835026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f391d3-a5e7-4344-ab5b-2e78c0b6411c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:38.836273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f391d3-a5e7-4344-ab5b-2e78c0b6411c None admin] RBAC: Adding query filter params (role.id=abf1096d1164471f9a47ae942e516329, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f, user.id=ae648c35da794682a988142b552736a2) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:38.836647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f391d3-a5e7-4344-ab5b-2e78c0b6411c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:38.838470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f391d3-a5e7-4344-ab5b-2e78c0b6411c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:38.847047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 109/213] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:38 2022] GET /identity/v3/role_assignments?user.id=ae648c35da794682a988142b552736a2&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=abf1096d1164471f9a47ae942e516329 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:38.848229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f391d3-a5e7-4344-ab5b-2e78c0b6411c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:39.011011 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9bd66-cb36-4e97-b059-f1048ef59955 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:39.026403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f391d3-a5e7-4344-ab5b-2e78c0b6411c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:39.050979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe97311-0912-43e0-a2a4-1c1854190129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:39.051754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe97311-0912-43e0-a2a4-1c1854190129 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.052025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe97311-0912-43e0-a2a4-1c1854190129 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.052305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe97311-0912-43e0-a2a4-1c1854190129 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.053713 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe97311-0912-43e0-a2a4-1c1854190129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:39.055170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe97311-0912-43e0-a2a4-1c1854190129 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:39.057231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 105/214] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:39.062596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe97311-0912-43e0-a2a4-1c1854190129 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:39.066737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0e6b4-a11a-4ba8-8cd2-926ff6c639a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:39.067979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e6b4-a11a-4ba8-8cd2-926ff6c639a5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.068652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e6b4-a11a-4ba8-8cd2-926ff6c639a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.069288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0e6b4-a11a-4ba8-8cd2-926ff6c639a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.070638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0e6b4-a11a-4ba8-8cd2-926ff6c639a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:39.071202 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0e6b4-a11a-4ba8-8cd2-926ff6c639a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:39.072950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0e6b4-a11a-4ba8-8cd2-926ff6c639a5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:39.082579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 110/215] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:39.088294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0e6b4-a11a-4ba8-8cd2-926ff6c639a5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:39.092928 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:39.146651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:39.182618 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe97311-0912-43e0-a2a4-1c1854190129 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:39.199914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0e6b4-a11a-4ba8-8cd2-926ff6c639a5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:39.223858 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e0e0-63e7-468f-8173-59ea07b7c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:39.224504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e0e0-63e7-468f-8173-59ea07b7c218 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.224818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e0e0-63e7-468f-8173-59ea07b7c218 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.225189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e0e0-63e7-468f-8173-59ea07b7c218 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.225965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e0e0-63e7-468f-8173-59ea07b7c218 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:39.227608 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e0e0-63e7-468f-8173-59ea07b7c218 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:39.243630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d719e7-020c-413b-8afc-4cda7c7fb2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:39.244352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d719e7-020c-413b-8afc-4cda7c7fb2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.244682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d719e7-020c-413b-8afc-4cda7c7fb2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.244935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d719e7-020c-413b-8afc-4cda7c7fb2f3 None admin] PATH_INFO: `/v3/users/fa3d580b225d45f08c9998f5bf37a624` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.254277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 106/216] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:50:39 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:50:39.256908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a283c-3f78-4151-aea9-3486685a3653 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.256908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a283c-3f78-4151-aea9-3486685a3653 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.256908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a283c-3f78-4151-aea9-3486685a3653 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.263672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 107/217] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:39.263672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd6de0-381c-43db-8441-baedd0e4081c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.263672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd6de0-381c-43db-8441-baedd0e4081c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.263968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd6de0-381c-43db-8441-baedd0e4081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.282037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d719e7-020c-413b-8afc-4cda7c7fb2f3 None admin] RBAC: Authorizing `identity:get_user(user_id=fa3d580b225d45f08c9998f5bf37a624)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:39.283613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d719e7-020c-413b-8afc-4cda7c7fb2f3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:39.285925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 111/218] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:39 2022] GET /identity/v3/users/fa3d580b225d45f08c9998f5bf37a624 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:39.291367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d719e7-020c-413b-8afc-4cda7c7fb2f3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:39.293684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-22bd6de0-381c-43db-8441-baedd0e4081c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:39.294953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-22bd6de0-381c-43db-8441-baedd0e4081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:39.390440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:39.400272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 108/219] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:39.438724 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d719e7-020c-413b-8afc-4cda7c7fb2f3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:39.475691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658d745-dd92-45f2-bf7f-a35599d5aa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:39.476311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658d745-dd92-45f2-bf7f-a35599d5aa28 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.476628 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658d745-dd92-45f2-bf7f-a35599d5aa28 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.476904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658d745-dd92-45f2-bf7f-a35599d5aa28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.551809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658d745-dd92-45f2-bf7f-a35599d5aa28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:39.553246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658d745-dd92-45f2-bf7f-a35599d5aa28 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:39.619902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:39.632012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db4a2e-aecb-49cf-b53f-2649fdcaea73 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.633228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db4a2e-aecb-49cf-b53f-2649fdcaea73 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.633539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db4a2e-aecb-49cf-b53f-2649fdcaea73 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.635110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 109/220] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:39.640314 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7c1e7-845b-45e8-b35d-8beb6c75d635 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.640625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7c1e7-845b-45e8-b35d-8beb6c75d635 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.640901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7c1e7-845b-45e8-b35d-8beb6c75d635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.665617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c9e7c1e7-845b-45e8-b35d-8beb6c75d635 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:39.666464 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 112/221] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:50:39.667393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c9e7c1e7-845b-45e8-b35d-8beb6c75d635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:39.672260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658d745-dd92-45f2-bf7f-a35599d5aa28 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:39.737375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:39.760300 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 110/222] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:39.761210 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7c1e7-845b-45e8-b35d-8beb6c75d635 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:39.800138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658d745-dd92-45f2-bf7f-a35599d5aa28 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:39.849266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74db88-6e3c-4227-90e7-bf64895ccfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:39.849835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74db88-6e3c-4227-90e7-bf64895ccfef None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.850120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74db88-6e3c-4227-90e7-bf64895ccfef None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.850451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74db88-6e3c-4227-90e7-bf64895ccfef None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.851649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74db88-6e3c-4227-90e7-bf64895ccfef None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:39.853201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74db88-6e3c-4227-90e7-bf64895ccfef None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:39.855243 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 113/223] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:39 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:39.861572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74db88-6e3c-4227-90e7-bf64895ccfef None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:39.887975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7c1e7-845b-45e8-b35d-8beb6c75d635 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:39.922606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:39.931617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039ec8a-21f9-4010-84db-652c7b360572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:39.933345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ec8a-21f9-4010-84db-652c7b360572 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:39.933795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ec8a-21f9-4010-84db-652c7b360572 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:39.934231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039ec8a-21f9-4010-84db-652c7b360572 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:39.946995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039ec8a-21f9-4010-84db-652c7b360572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7039ec8a-21f9-4010-84db-652c7b360572 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:39.953172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:39.954086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:39.954910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:39.957972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 111/224] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:50:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:39.963476 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039ec8a-21f9-4010-84db-652c7b360572 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:40.020324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:40.077539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74db88-6e3c-4227-90e7-bf64895ccfef None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:40.091457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039ec8a-21f9-4010-84db-652c7b360572 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:40.113697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75f2c4-9e67-425e-874d-a792c8f003ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:40.114244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75f2c4-9e67-425e-874d-a792c8f003ef None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:40.114527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75f2c4-9e67-425e-874d-a792c8f003ef None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:40.114803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75f2c4-9e67-425e-874d-a792c8f003ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:40.115538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75f2c4-9e67-425e-874d-a792c8f003ef None admin] RBAC: Adding query filter params (role.id=6bf2c10dc09a4e9087fd12312566376f, scope.project.id=b872016c0ae541aab80d335607224572, user.id=fa3d580b225d45f08c9998f5bf37a624) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:40.116113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75f2c4-9e67-425e-874d-a792c8f003ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:40.117611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75f2c4-9e67-425e-874d-a792c8f003ef None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:40.128911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 114/225] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:39 2022] GET /identity/v3/role_assignments?user.id=fa3d580b225d45f08c9998f5bf37a624&scope.project.id=b872016c0ae541aab80d335607224572&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:40.129870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75f2c4-9e67-425e-874d-a792c8f003ef None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:40.133943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e5794-7f66-4e81-9795-eae72a8a95a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:40.134931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5794-7f66-4e81-9795-eae72a8a95a4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:40.135428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5794-7f66-4e81-9795-eae72a8a95a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:40.135898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5794-7f66-4e81-9795-eae72a8a95a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:40.136844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e5794-7f66-4e81-9795-eae72a8a95a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:40.137367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e5794-7f66-4e81-9795-eae72a8a95a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:40.140206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e5794-7f66-4e81-9795-eae72a8a95a4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:40.150793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 112/226] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:40.157663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e5794-7f66-4e81-9795-eae72a8a95a4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:40.315806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:40.326070 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75f2c4-9e67-425e-874d-a792c8f003ef None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:40.327413 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e5794-7f66-4e81-9795-eae72a8a95a4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:40.337640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:40.364867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5745e-136b-4ad0-bfde-cc65f7d3075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:40.365389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5745e-136b-4ad0-bfde-cc65f7d3075f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:40.365940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5745e-136b-4ad0-bfde-cc65f7d3075f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:40.366217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5745e-136b-4ad0-bfde-cc65f7d3075f None admin] PATH_INFO: `/v3/users/1fe7fe37f16845ccb8846616c3e3c715` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:40.366600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0b11e-d9f1-4139-be97-ac3bb20df9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:40.367250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0b11e-d9f1-4139-be97-ac3bb20df9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:40.367353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5745e-136b-4ad0-bfde-cc65f7d3075f None admin] RBAC: Authorizing `identity:get_user(user_id=1fe7fe37f16845ccb8846616c3e3c715)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:40.367536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0b11e-d9f1-4139-be97-ac3bb20df9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:40.367818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0b11e-d9f1-4139-be97-ac3bb20df9c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:40.368831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5745e-136b-4ad0-bfde-cc65f7d3075f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:40.370800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 113/227] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:40 2022] GET /identity/v3/users/1fe7fe37f16845ccb8846616c3e3c715 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:40.375776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5745e-136b-4ad0-bfde-cc65f7d3075f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:40.393472 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0b11e-d9f1-4139-be97-ac3bb20df9c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9ba0b11e-d9f1-4139-be97-ac3bb20df9c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:40.398663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:40.399575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:40.400397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 115/228] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:50:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:40.407267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0b11e-d9f1-4139-be97-ac3bb20df9c6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:40.551470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5745e-136b-4ad0-bfde-cc65f7d3075f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:40.592030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0b11e-d9f1-4139-be97-ac3bb20df9c6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:40.614663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71c95e-fca5-4799-9d27-5202683eeb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:40.616360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71c95e-fca5-4799-9d27-5202683eeb2b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:40.616619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71c95e-fca5-4799-9d27-5202683eeb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:40.616900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71c95e-fca5-4799-9d27-5202683eeb2b None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:40.618227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71c95e-fca5-4799-9d27-5202683eeb2b None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:40.619675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71c95e-fca5-4799-9d27-5202683eeb2b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:40.624044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 114/229] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:40 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:40.629337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71c95e-fca5-4799-9d27-5202683eeb2b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:40.658062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee120fd-bf4f-48d6-b70b-4bda2d732945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:40.659420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee120fd-bf4f-48d6-b70b-4bda2d732945 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:40.659906 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee120fd-bf4f-48d6-b70b-4bda2d732945 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:40.660571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee120fd-bf4f-48d6-b70b-4bda2d732945 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:40.661556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee120fd-bf4f-48d6-b70b-4bda2d732945 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:40.662065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee120fd-bf4f-48d6-b70b-4bda2d732945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:40.663772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee120fd-bf4f-48d6-b70b-4bda2d732945 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:40.682269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 116/230] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:50:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:40.688393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:40.691056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee120fd-bf4f-48d6-b70b-4bda2d732945 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:40.729126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:40.756064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71c95e-fca5-4799-9d27-5202683eeb2b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:40.795119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27da35-5c00-40fc-8303-0204557ff919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:40.796324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27da35-5c00-40fc-8303-0204557ff919 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:40.797179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27da35-5c00-40fc-8303-0204557ff919 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:40.797640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27da35-5c00-40fc-8303-0204557ff919 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572/users/1fe7fe37f16845ccb8846616c3e3c715/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:40.800494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27da35-5c00-40fc-8303-0204557ff919 None admin] RBAC: Authorizing `identity:create_grant(project_id=b872016c0ae541aab80d335607224572, user_id=1fe7fe37f16845ccb8846616c3e3c715, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:40.802493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27da35-5c00-40fc-8303-0204557ff919 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:40.819717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 115/231] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:50:40 2022] PUT /identity/v3/projects/b872016c0ae541aab80d335607224572/users/1fe7fe37f16845ccb8846616c3e3c715/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:40.916855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee120fd-bf4f-48d6-b70b-4bda2d732945 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:40.973278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e121ed7-5de8-492c-afc4-36fe027cc97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:40.974262 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e121ed7-5de8-492c-afc4-36fe027cc97d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:40.974783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e121ed7-5de8-492c-afc4-36fe027cc97d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:40.975272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e121ed7-5de8-492c-afc4-36fe027cc97d None admin] PATH_INFO: `/v3/users/1fe7fe37f16845ccb8846616c3e3c715` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:40.976823 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e121ed7-5de8-492c-afc4-36fe027cc97d None admin] RBAC: Authorizing `identity:get_user(user_id=1fe7fe37f16845ccb8846616c3e3c715)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:40.978476 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e121ed7-5de8-492c-afc4-36fe027cc97d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:40.980309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 117/232] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:40 2022] GET /identity/v3/users/1fe7fe37f16845ccb8846616c3e3c715 => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:40.986867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27da35-5c00-40fc-8303-0204557ff919 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:41.096058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27da35-5c00-40fc-8303-0204557ff919 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:41.098648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:41.147539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee0601-45fc-4250-b490-7174a5402e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:41.148190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee0601-45fc-4250-b490-7174a5402e2d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:41.148489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee0601-45fc-4250-b490-7174a5402e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:41.148783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee0601-45fc-4250-b490-7174a5402e2d None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:41.149916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee0601-45fc-4250-b490-7174a5402e2d None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:41.151439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee0601-45fc-4250-b490-7174a5402e2d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:41.153413 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 116/233] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:40 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:41.159133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e121ed7-5de8-492c-afc4-36fe027cc97d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:41.253883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:41.271701 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e121ed7-5de8-492c-afc4-36fe027cc97d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:41.307937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc02dd-9ea1-462e-8261-c7c376402d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:41.309023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc02dd-9ea1-462e-8261-c7c376402d74 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:41.309507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc02dd-9ea1-462e-8261-c7c376402d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:41.310006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc02dd-9ea1-462e-8261-c7c376402d74 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572/users/1fe7fe37f16845ccb8846616c3e3c715/roles/f196d84ade534597912f4ce3ca3f36ee` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:41.312429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc02dd-9ea1-462e-8261-c7c376402d74 None admin] RBAC: Authorizing `identity:create_grant(project_id=b872016c0ae541aab80d335607224572, user_id=1fe7fe37f16845ccb8846616c3e3c715, role_id=f196d84ade534597912f4ce3ca3f36ee)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:41.314125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc02dd-9ea1-462e-8261-c7c376402d74 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:41.339256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 118/234] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:50:41 2022] PUT /identity/v3/projects/b872016c0ae541aab80d335607224572/users/1fe7fe37f16845ccb8846616c3e3c715/roles/f196d84ade534597912f4ce3ca3f36ee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:41.857504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a13aa-9270-4f2e-b9e1-bd089724813d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:41.858019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a13aa-9270-4f2e-b9e1-bd089724813d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:41.858281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a13aa-9270-4f2e-b9e1-bd089724813d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:41.859563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 117/235] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:41.865978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad8c5a-a943-4e09-bcab-74ee2befe9be None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:41.866477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad8c5a-a943-4e09-bcab-74ee2befe9be None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:41.866556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad8c5a-a943-4e09-bcab-74ee2befe9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:41.889390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-dcad8c5a-a943-4e09-bcab-74ee2befe9be None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:41.890587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dcad8c5a-a943-4e09-bcab-74ee2befe9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:41.951836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cff879-cb2e-4142-bdf5-35998eaf12e1 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:41.952161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cff879-cb2e-4142-bdf5-35998eaf12e1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:41.952399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cff879-cb2e-4142-bdf5-35998eaf12e1 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:41.954054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 118/236] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:41.959702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893572dd-328e-4eef-88c9-9b9e669f32bc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:41.959999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893572dd-328e-4eef-88c9-9b9e669f32bc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:41.960273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893572dd-328e-4eef-88c9-9b9e669f32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:41.980512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-893572dd-328e-4eef-88c9-9b9e669f32bc None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:41.980833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 119/237] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:41.981677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-893572dd-328e-4eef-88c9-9b9e669f32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:42.095186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 119/238] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:42.445641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad8c5a-a943-4e09-bcab-74ee2befe9be None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:42.490270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ba32a-7e5a-4f98-88f1-c1b5f1500efe None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:42.491175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ba32a-7e5a-4f98-88f1-c1b5f1500efe None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:42.491859 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ba32a-7e5a-4f98-88f1-c1b5f1500efe None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:42.494227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 120/239] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:42.500801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f5a28-df90-4053-8845-9c50e094bd06 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:42.501419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f5a28-df90-4053-8845-9c50e094bd06 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:42.501895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f5a28-df90-4053-8845-9c50e094bd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:42.529703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-af9f5a28-df90-4053-8845-9c50e094bd06 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:42.535030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-af9f5a28-df90-4053-8845-9c50e094bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:42.565224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:42.590895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad8c5a-a943-4e09-bcab-74ee2befe9be None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:42.624189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 121/240] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:42.625330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f5a28-df90-4053-8845-9c50e094bd06 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:42.642766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd352c0-4aff-423b-874e-0362b75840ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:42.643617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd352c0-4aff-423b-874e-0362b75840ff None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:42.644139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd352c0-4aff-423b-874e-0362b75840ff None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:42.644674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd352c0-4aff-423b-874e-0362b75840ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:42.646749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd352c0-4aff-423b-874e-0362b75840ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:42.652298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd352c0-4aff-423b-874e-0362b75840ff None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:42.654596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 120/241] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:42.660662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd352c0-4aff-423b-874e-0362b75840ff None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:42.665396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:42.787486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f5a28-df90-4053-8845-9c50e094bd06 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:42.842446 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd352c0-4aff-423b-874e-0362b75840ff None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:42.875029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d623b-37ca-4bb6-9685-9dfdb3adf189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:42.875726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d623b-37ca-4bb6-9685-9dfdb3adf189 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:42.875957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d623b-37ca-4bb6-9685-9dfdb3adf189 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:42.876232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d623b-37ca-4bb6-9685-9dfdb3adf189 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:42.899205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d623b-37ca-4bb6-9685-9dfdb3adf189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b20d623b-37ca-4bb6-9685-9dfdb3adf189 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:42.905334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:42.906262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:42.907076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:42.909998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 122/242] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:42.914931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf39e87-9769-4ef8-b835-a9f1ce78353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:42.914931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39e87-9769-4ef8-b835-a9f1ce78353f None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:42.914931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39e87-9769-4ef8-b835-a9f1ce78353f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:42.914931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39e87-9769-4ef8-b835-a9f1ce78353f None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:42.915616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf39e87-9769-4ef8-b835-a9f1ce78353f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:42.915616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf39e87-9769-4ef8-b835-a9f1ce78353f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:42.916868 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d623b-37ca-4bb6-9685-9dfdb3adf189 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:42.950216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:42.972510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 121/243] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:50:42 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:50:42.993677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf39e87-9769-4ef8-b835-a9f1ce78353f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:43.081037 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:43.094328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d623b-37ca-4bb6-9685-9dfdb3adf189 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:43.145223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11befb67-6cf0-479c-bd2d-694cbad8ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:43.146260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11befb67-6cf0-479c-bd2d-694cbad8ad3c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:43.148018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11befb67-6cf0-479c-bd2d-694cbad8ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:43.148564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11befb67-6cf0-479c-bd2d-694cbad8ad3c None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:43.149663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11befb67-6cf0-479c-bd2d-694cbad8ad3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:43.153962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11befb67-6cf0-479c-bd2d-694cbad8ad3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:43.155900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11befb67-6cf0-479c-bd2d-694cbad8ad3c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:43.173579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 123/244] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:43.180600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11befb67-6cf0-479c-bd2d-694cbad8ad3c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:43.227351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf39e87-9769-4ef8-b835-a9f1ce78353f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:43.276845 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0311c-433b-42fb-a22e-8df885f058f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:43.278021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0311c-433b-42fb-a22e-8df885f058f5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:43.278532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0311c-433b-42fb-a22e-8df885f058f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:43.279026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0311c-433b-42fb-a22e-8df885f058f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:43.297523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0311c-433b-42fb-a22e-8df885f058f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-46f0311c-433b-42fb-a22e-8df885f058f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:43.312345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:43.314155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:43.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:43.320122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 122/245] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:50:43.325917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0311c-433b-42fb-a22e-8df885f058f5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:43.328751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11befb67-6cf0-479c-bd2d-694cbad8ad3c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:43.403632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:43.411632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b7bd9-cbc0-45b9-b934-2eb3eb1ed9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:43.412986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b7bd9-cbc0-45b9-b934-2eb3eb1ed9de None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:43.413512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b7bd9-cbc0-45b9-b934-2eb3eb1ed9de None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:43.414087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b7bd9-cbc0-45b9-b934-2eb3eb1ed9de None admin] PATH_INFO: `/v3/users/1133436059f04feaa446ddfe3b7d6f74` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:43.443660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b7bd9-cbc0-45b9-b934-2eb3eb1ed9de None admin] RBAC: Authorizing `identity:get_user(user_id=1133436059f04feaa446ddfe3b7d6f74)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:43.446308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b7bd9-cbc0-45b9-b934-2eb3eb1ed9de None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:43.450722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 124/246] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:43 2022] GET /identity/v3/users/1133436059f04feaa446ddfe3b7d6f74 => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:43.457153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783c7d-f50e-4228-a29b-2649d6fca091 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:43.457594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783c7d-f50e-4228-a29b-2649d6fca091 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:43.457886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783c7d-f50e-4228-a29b-2649d6fca091 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:43.459657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 125/247] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:43.463149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61783c7d-f50e-4228-a29b-2649d6fca091 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:43.469319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0311c-433b-42fb-a22e-8df885f058f5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:43.483004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:43.516964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373e7aa-d751-44bb-9b17-35b140f565d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:43.517653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373e7aa-d751-44bb-9b17-35b140f565d7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:43.517971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373e7aa-d751-44bb-9b17-35b140f565d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:43.518688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373e7aa-d751-44bb-9b17-35b140f565d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:43.518919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373e7aa-d751-44bb-9b17-35b140f565d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:43.519230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373e7aa-d751-44bb-9b17-35b140f565d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:43.521594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373e7aa-d751-44bb-9b17-35b140f565d7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:43.532882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 123/248] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:43.534448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91964a-d0cc-4374-a7ca-0627f16b8f68 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:43.534734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91964a-d0cc-4374-a7ca-0627f16b8f68 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:43.535007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91964a-d0cc-4374-a7ca-0627f16b8f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:43.566215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3f91964a-d0cc-4374-a7ca-0627f16b8f68 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:43.567432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3f91964a-d0cc-4374-a7ca-0627f16b8f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:43.613057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61783c7d-f50e-4228-a29b-2649d6fca091 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:43.659590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 124/249] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:43.660319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91964a-d0cc-4374-a7ca-0627f16b8f68 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:43.666011 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df84176-5fe5-4430-8f6e-e315378345cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:43.667366 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df84176-5fe5-4430-8f6e-e315378345cd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:43.668759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df84176-5fe5-4430-8f6e-e315378345cd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:43.669896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df84176-5fe5-4430-8f6e-e315378345cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:43.762162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:43.801455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df84176-5fe5-4430-8f6e-e315378345cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:43.803329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df84176-5fe5-4430-8f6e-e315378345cd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:43.820743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:43.851738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91964a-d0cc-4374-a7ca-0627f16b8f68 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:43.896490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19cfb8-ca37-4ec4-b553-7d6e928fe3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:43.897157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19cfb8-ca37-4ec4-b553-7d6e928fe3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:43.897937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19cfb8-ca37-4ec4-b553-7d6e928fe3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:43.898229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19cfb8-ca37-4ec4-b553-7d6e928fe3b8 None admin] PATH_INFO: `/v3/users/fa3d580b225d45f08c9998f5bf37a624` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:43.899744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19cfb8-ca37-4ec4-b553-7d6e928fe3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=fa3d580b225d45f08c9998f5bf37a624)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:43.901493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19cfb8-ca37-4ec4-b553-7d6e928fe3b8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:43.904188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 125/250] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:43 2022] GET /identity/v3/users/fa3d580b225d45f08c9998f5bf37a624 => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:43.905621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961b9c-d040-45c4-897b-b1e677257a92 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:43.905908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961b9c-d040-45c4-897b-b1e677257a92 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:43.906190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961b9c-d040-45c4-897b-b1e677257a92 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:43.913085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 126/251] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:43.913837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961b9c-d040-45c4-897b-b1e677257a92 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:43.952002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 126/252] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:43.958356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b588da3-7265-43bf-9200-a43a30150a91 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:43.958658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b588da3-7265-43bf-9200-a43a30150a91 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:43.958975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b588da3-7265-43bf-9200-a43a30150a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:43.984401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7b588da3-7265-43bf-9200-a43a30150a91 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:43.985704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7b588da3-7265-43bf-9200-a43a30150a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:44.069716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 127/253] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:44.071264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b588da3-7265-43bf-9200-a43a30150a91 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:44.094601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961b9c-d040-45c4-897b-b1e677257a92 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:44.143519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:44.174585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:44.188762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe2091-a66c-4204-8f43-5792ac1f2743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:44.191500 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe2091-a66c-4204-8f43-5792ac1f2743 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:44.191944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe2091-a66c-4204-8f43-5792ac1f2743 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:44.192363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe2091-a66c-4204-8f43-5792ac1f2743 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:44.197678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe2091-a66c-4204-8f43-5792ac1f2743 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:44.199383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe2091-a66c-4204-8f43-5792ac1f2743 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:44.202330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 127/254] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:43 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:44.206328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe2091-a66c-4204-8f43-5792ac1f2743 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:44.274075 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b588da3-7265-43bf-9200-a43a30150a91 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:44.317254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9471cf-a6a6-42d7-ba04-349097111a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:44.319297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9471cf-a6a6-42d7-ba04-349097111a00 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:44.321405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9471cf-a6a6-42d7-ba04-349097111a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:44.321848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9471cf-a6a6-42d7-ba04-349097111a00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:44.350218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9471cf-a6a6-42d7-ba04-349097111a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-be9471cf-a6a6-42d7-ba04-349097111a00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:44.357243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:44.358450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:50:44.359448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:44.361922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 128/255] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:44.362774 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9471cf-a6a6-42d7-ba04-349097111a00 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:44.437451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe2091-a66c-4204-8f43-5792ac1f2743 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:44.488691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08f6c5-e6ea-4cdc-8bc1-5d60272b94f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:44.489845 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08f6c5-e6ea-4cdc-8bc1-5d60272b94f5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:44.490300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08f6c5-e6ea-4cdc-8bc1-5d60272b94f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:44.491243 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08f6c5-e6ea-4cdc-8bc1-5d60272b94f5 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:44.493108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08f6c5-e6ea-4cdc-8bc1-5d60272b94f5 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:44.494756 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08f6c5-e6ea-4cdc-8bc1-5d60272b94f5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:44.497933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 128/256] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:44 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:44.503379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08f6c5-e6ea-4cdc-8bc1-5d60272b94f5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:44.518464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9471cf-a6a6-42d7-ba04-349097111a00 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:44.521633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:44.565824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:44.574465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c20ac-1aef-4e4d-95fa-c1acc2ea6ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:44.576077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c20ac-1aef-4e4d-95fa-c1acc2ea6ea2 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:44.576701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c20ac-1aef-4e4d-95fa-c1acc2ea6ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:44.577124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c20ac-1aef-4e4d-95fa-c1acc2ea6ea2 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572/users/fa3d580b225d45f08c9998f5bf37a624/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:44.580121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c20ac-1aef-4e4d-95fa-c1acc2ea6ea2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b872016c0ae541aab80d335607224572, user_id=fa3d580b225d45f08c9998f5bf37a624, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:44.582957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c20ac-1aef-4e4d-95fa-c1acc2ea6ea2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:44.600968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 129/257] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:50:44 2022] PUT /identity/v3/projects/b872016c0ae541aab80d335607224572/users/fa3d580b225d45f08c9998f5bf37a624/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:44.602404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c20ac-1aef-4e4d-95fa-c1acc2ea6ea2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:44.630971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08f6c5-e6ea-4cdc-8bc1-5d60272b94f5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:44.683533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893e3b9-a35a-453a-b719-8b8416d41afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:44.684991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893e3b9-a35a-453a-b719-8b8416d41afb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:44.685701 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893e3b9-a35a-453a-b719-8b8416d41afb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:44.686124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893e3b9-a35a-453a-b719-8b8416d41afb None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:44.687302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893e3b9-a35a-453a-b719-8b8416d41afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:44.687785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893e3b9-a35a-453a-b719-8b8416d41afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:44.690180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893e3b9-a35a-453a-b719-8b8416d41afb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:44.703642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 129/258] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:44.704916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893e3b9-a35a-453a-b719-8b8416d41afb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:44.757716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c20ac-1aef-4e4d-95fa-c1acc2ea6ea2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:44.798639 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc303a6-d258-42ab-8946-f867f2677944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:44.799400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc303a6-d258-42ab-8946-f867f2677944 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:44.799689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc303a6-d258-42ab-8946-f867f2677944 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:44.799968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc303a6-d258-42ab-8946-f867f2677944 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:44.812599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc303a6-d258-42ab-8946-f867f2677944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7cc303a6-d258-42ab-8946-f867f2677944 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:44.819699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:44.820900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:44.821877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 130/259] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:50:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:44.822532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc303a6-d258-42ab-8946-f867f2677944 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:44.833369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893e3b9-a35a-453a-b719-8b8416d41afb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:44.852765 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:44.874889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:44.920102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a75385-3d84-46bd-868c-cabce46cfd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:44.921171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75385-3d84-46bd-868c-cabce46cfd62 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:44.921669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75385-3d84-46bd-868c-cabce46cfd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:44.922141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75385-3d84-46bd-868c-cabce46cfd62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:44.923190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a75385-3d84-46bd-868c-cabce46cfd62 None admin] RBAC: Adding query filter params (role.id=abf1096d1164471f9a47ae942e516329, scope.project.id=b872016c0ae541aab80d335607224572, user.id=1133436059f04feaa446ddfe3b7d6f74) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:44.923903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a75385-3d84-46bd-868c-cabce46cfd62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:44.925688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a75385-3d84-46bd-868c-cabce46cfd62 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:44.933208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 130/260] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:44 2022] GET /identity/v3/role_assignments?user.id=1133436059f04feaa446ddfe3b7d6f74&scope.project.id=b872016c0ae541aab80d335607224572&role.id=abf1096d1164471f9a47ae942e516329 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:44.941732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a75385-3d84-46bd-868c-cabce46cfd62 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:44.944602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc303a6-d258-42ab-8946-f867f2677944 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:44.988718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278b17e-3785-4fa0-89e1-1ada83f6af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:44.989508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b17e-3785-4fa0-89e1-1ada83f6af4d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:44.989697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b17e-3785-4fa0-89e1-1ada83f6af4d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:44.990392 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b17e-3785-4fa0-89e1-1ada83f6af4d None admin] PATH_INFO: `/v3/users/1fe7fe37f16845ccb8846616c3e3c715` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:44.994250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278b17e-3785-4fa0-89e1-1ada83f6af4d None admin] RBAC: Authorizing `identity:get_user(user_id=1fe7fe37f16845ccb8846616c3e3c715)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:44.997951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278b17e-3785-4fa0-89e1-1ada83f6af4d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:45.003504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 131/261] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:44 2022] GET /identity/v3/users/1fe7fe37f16845ccb8846616c3e3c715 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:45.011192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278b17e-3785-4fa0-89e1-1ada83f6af4d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:45.145539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a75385-3d84-46bd-868c-cabce46cfd62 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:45.216124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:45.227258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bbc08-4379-4f94-a7f9-567e8f05cdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:45.227969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bbc08-4379-4f94-a7f9-567e8f05cdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:45.228325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bbc08-4379-4f94-a7f9-567e8f05cdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:45.228700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bbc08-4379-4f94-a7f9-567e8f05cdf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:45.229454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bbc08-4379-4f94-a7f9-567e8f05cdf2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:45.229835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bbc08-4379-4f94-a7f9-567e8f05cdf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:45.230549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278b17e-3785-4fa0-89e1-1ada83f6af4d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:45.231410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bbc08-4379-4f94-a7f9-567e8f05cdf2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:45.262757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 131/262] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:50:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:45.271624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bbc08-4379-4f94-a7f9-567e8f05cdf2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:45.273744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6dec2-c5d7-4dce-832c-c188fac19615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:45.276480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6dec2-c5d7-4dce-832c-c188fac19615 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:45.276480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6dec2-c5d7-4dce-832c-c188fac19615 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:45.276480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6dec2-c5d7-4dce-832c-c188fac19615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:45.398515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:45.540327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6dec2-c5d7-4dce-832c-c188fac19615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:45.542998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6dec2-c5d7-4dce-832c-c188fac19615 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:45.600133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bbc08-4379-4f94-a7f9-567e8f05cdf2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:45.730516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb700c-ae3b-4acc-82ee-446437a17758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:45.731519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb700c-ae3b-4acc-82ee-446437a17758 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:45.732136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb700c-ae3b-4acc-82ee-446437a17758 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:45.732654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb700c-ae3b-4acc-82ee-446437a17758 None admin] PATH_INFO: `/v3/users/1fe7fe37f16845ccb8846616c3e3c715` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:45.737664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb700c-ae3b-4acc-82ee-446437a17758 None admin] RBAC: Authorizing `identity:get_user(user_id=1fe7fe37f16845ccb8846616c3e3c715)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:45.744479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb700c-ae3b-4acc-82ee-446437a17758 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:45.749098 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 132/263] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:45 2022] GET /identity/v3/users/1fe7fe37f16845ccb8846616c3e3c715 => generated 283 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:45.760257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb700c-ae3b-4acc-82ee-446437a17758 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:45.825525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:45.858070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 132/264] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 847 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:45.860265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb452f98-fd55-4a4f-8ecb-02e762e45023 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:45.860786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb452f98-fd55-4a4f-8ecb-02e762e45023 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:45.865905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb452f98-fd55-4a4f-8ecb-02e762e45023 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:45.868312 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 133/265] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:45.869604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb452f98-fd55-4a4f-8ecb-02e762e45023 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:46.000234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb700c-ae3b-4acc-82ee-446437a17758 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:46.019974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:46.028785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb452f98-fd55-4a4f-8ecb-02e762e45023 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:46.065955 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e80c9-75c0-4c46-b430-fc0f6e87d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:46.066598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e80c9-75c0-4c46-b430-fc0f6e87d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:46.066882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e80c9-75c0-4c46-b430-fc0f6e87d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:46.067157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e80c9-75c0-4c46-b430-fc0f6e87d5f0 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:46.068298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e80c9-75c0-4c46-b430-fc0f6e87d5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:46.069820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e80c9-75c0-4c46-b430-fc0f6e87d5f0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:46.071664 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 134/266] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:45 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:46.072873 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52da96-092f-4b26-a5da-551047c2b3cd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:46.073151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52da96-092f-4b26-a5da-551047c2b3cd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:46.073430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52da96-092f-4b26-a5da-551047c2b3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:46.075993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e155c-6ee5-4bee-9c0c-b18b07057a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:46.080549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e155c-6ee5-4bee-9c0c-b18b07057a8d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:46.080886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e155c-6ee5-4bee-9c0c-b18b07057a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:46.081166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e155c-6ee5-4bee-9c0c-b18b07057a8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:46.109856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4e52da96-092f-4b26-a5da-551047c2b3cd None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:46.111057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4e52da96-092f-4b26-a5da-551047c2b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:46.207327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:46.208574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e155c-6ee5-4bee-9c0c-b18b07057a8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:46.210071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e155c-6ee5-4bee-9c0c-b18b07057a8d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:46.222675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 135/267] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:46.223528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52da96-092f-4b26-a5da-551047c2b3cd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:46.328565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 133/268] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:50:46.329745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b020f-a666-460d-b9cd-7d13a9279e55 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:46.330609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b020f-a666-460d-b9cd-7d13a9279e55 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:46.330890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b020f-a666-460d-b9cd-7d13a9279e55 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:46.332144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 134/269] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:46.341467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b020f-a666-460d-b9cd-7d13a9279e55 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:46.344980 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52da96-092f-4b26-a5da-551047c2b3cd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:46.360553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:46.390783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb1165-6554-4fa7-aa01-beedf6c4c419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:46.391394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1165-6554-4fa7-aa01-beedf6c4c419 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:46.391678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1165-6554-4fa7-aa01-beedf6c4c419 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:46.391960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1165-6554-4fa7-aa01-beedf6c4c419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:46.393277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1165-6554-4fa7-aa01-beedf6c4c419 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=b872016c0ae541aab80d335607224572, user.id=1fe7fe37f16845ccb8846616c3e3c715) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:46.393591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1165-6554-4fa7-aa01-beedf6c4c419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:46.395059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1165-6554-4fa7-aa01-beedf6c4c419 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:46.410338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 136/270] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:46 2022] GET /identity/v3/role_assignments?user.id=1fe7fe37f16845ccb8846616c3e3c715&scope.project.id=b872016c0ae541aab80d335607224572&role.id=56228137a4444ef9b7e688d04abd00fd => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:46.411372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3f35c-ac5e-49c7-adf8-f4bf986aec4b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:46.411749 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3f35c-ac5e-49c7-adf8-f4bf986aec4b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:46.413464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3f35c-ac5e-49c7-adf8-f4bf986aec4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:46.440505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bcf3f35c-ac5e-49c7-adf8-f4bf986aec4b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:46.441907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bcf3f35c-ac5e-49c7-adf8-f4bf986aec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:46.509032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:46.519137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 137/271] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:46.551585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b020f-a666-460d-b9cd-7d13a9279e55 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:46.600680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627cd49-1418-4560-ab36-49b6270597cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:46.601273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627cd49-1418-4560-ab36-49b6270597cc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:46.601556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627cd49-1418-4560-ab36-49b6270597cc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:46.601831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627cd49-1418-4560-ab36-49b6270597cc None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:46.603144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627cd49-1418-4560-ab36-49b6270597cc None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:46.604703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627cd49-1418-4560-ab36-49b6270597cc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:46.606899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 135/272] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:46 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:46.612903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3f35c-ac5e-49c7-adf8-f4bf986aec4b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:46.648381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627cd49-1418-4560-ab36-49b6270597cc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:46.744900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:46.763990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627cd49-1418-4560-ab36-49b6270597cc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:46.807488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb635659-193d-4ca6-8b6f-e66c7618e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:46.808250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb635659-193d-4ca6-8b6f-e66c7618e41a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:46.808583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb635659-193d-4ca6-8b6f-e66c7618e41a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:46.808860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb635659-193d-4ca6-8b6f-e66c7618e41a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:46.817198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3f35c-ac5e-49c7-adf8-f4bf986aec4b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:46.825121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb635659-193d-4ca6-8b6f-e66c7618e41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-bb635659-193d-4ca6-8b6f-e66c7618e41a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:46.830345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:46.831307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:46.832332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 136/273] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:46.837785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb635659-193d-4ca6-8b6f-e66c7618e41a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:46.895329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f68f18-08ce-45c9-9a39-d7cdeb3b3587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:46.896970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f68f18-08ce-45c9-9a39-d7cdeb3b3587 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:46.897260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f68f18-08ce-45c9-9a39-d7cdeb3b3587 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:46.897536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f68f18-08ce-45c9-9a39-d7cdeb3b3587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:46.898291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f68f18-08ce-45c9-9a39-d7cdeb3b3587 None admin] RBAC: Adding query filter params (role.id=f196d84ade534597912f4ce3ca3f36ee, scope.project.id=b872016c0ae541aab80d335607224572, user.id=1fe7fe37f16845ccb8846616c3e3c715) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:46.898680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f68f18-08ce-45c9-9a39-d7cdeb3b3587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:46.900361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f68f18-08ce-45c9-9a39-d7cdeb3b3587 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:46.919009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 138/274] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:46 2022] GET /identity/v3/role_assignments?user.id=1fe7fe37f16845ccb8846616c3e3c715&scope.project.id=b872016c0ae541aab80d335607224572&role.id=f196d84ade534597912f4ce3ca3f36ee => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:46.948653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f68f18-08ce-45c9-9a39-d7cdeb3b3587 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:47.034556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb635659-193d-4ca6-8b6f-e66c7618e41a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:47.041165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:47.110506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df779277-f3c6-4a09-a74a-3d921065dad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:47.111188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df779277-f3c6-4a09-a74a-3d921065dad3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:47.111479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df779277-f3c6-4a09-a74a-3d921065dad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:47.111757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df779277-f3c6-4a09-a74a-3d921065dad3 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:47.112436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df779277-f3c6-4a09-a74a-3d921065dad3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:47.112766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df779277-f3c6-4a09-a74a-3d921065dad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:47.116091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df779277-f3c6-4a09-a74a-3d921065dad3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:47.122924 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:47.129327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 137/275] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:47.135176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df779277-f3c6-4a09-a74a-3d921065dad3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:47.140843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f68f18-08ce-45c9-9a39-d7cdeb3b3587 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:47.184434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c547ea2-ea67-47a0-8b1b-380bdc712a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:47.186492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c547ea2-ea67-47a0-8b1b-380bdc712a59 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:47.186982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c547ea2-ea67-47a0-8b1b-380bdc712a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:47.187486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c547ea2-ea67-47a0-8b1b-380bdc712a59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:47.188870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c547ea2-ea67-47a0-8b1b-380bdc712a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:47.191729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c547ea2-ea67-47a0-8b1b-380bdc712a59 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:47.194769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 139/276] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:47.200452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c547ea2-ea67-47a0-8b1b-380bdc712a59 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:47.272430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df779277-f3c6-4a09-a74a-3d921065dad3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:47.312613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d226a4-16c7-4f34-93b9-4e53232f5f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:47.313674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d226a4-16c7-4f34-93b9-4e53232f5f76 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:47.314159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d226a4-16c7-4f34-93b9-4e53232f5f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:47.314667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d226a4-16c7-4f34-93b9-4e53232f5f76 None admin] PATH_INFO: `/v3/users/8240019a9313476580d712c19891d7c5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:47.330931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d226a4-16c7-4f34-93b9-4e53232f5f76 None admin] RBAC: Authorizing `identity:get_user(user_id=8240019a9313476580d712c19891d7c5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:47.331229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c547ea2-ea67-47a0-8b1b-380bdc712a59 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:47.332937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d226a4-16c7-4f34-93b9-4e53232f5f76 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:47.335207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 138/277] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:47 2022] GET /identity/v3/users/8240019a9313476580d712c19891d7c5 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:47.341826 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d226a4-16c7-4f34-93b9-4e53232f5f76 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:47.352920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:47.377778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52aabd-4dfd-4b94-b6b0-cbb94394f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:47.378790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52aabd-4dfd-4b94-b6b0-cbb94394f521 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:47.379765 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52aabd-4dfd-4b94-b6b0-cbb94394f521 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:47.380197 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52aabd-4dfd-4b94-b6b0-cbb94394f521 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:47.381343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52aabd-4dfd-4b94-b6b0-cbb94394f521 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:47.383159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52aabd-4dfd-4b94-b6b0-cbb94394f521 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:47.414750 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 140/278] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:50:47 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:50:47.416648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc12c8-ebb5-4c6d-85d1-56406d15bf70 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:47.416648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc12c8-ebb5-4c6d-85d1-56406d15bf70 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:47.417166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc12c8-ebb5-4c6d-85d1-56406d15bf70 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:47.419233 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 141/279] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:47.426335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de8d5c-b796-44a1-b5ee-c31ed2f7f3dc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:47.426763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de8d5c-b796-44a1-b5ee-c31ed2f7f3dc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:47.427115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de8d5c-b796-44a1-b5ee-c31ed2f7f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:47.428741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:47.450352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-90de8d5c-b796-44a1-b5ee-c31ed2f7f3dc None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:47.451957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-90de8d5c-b796-44a1-b5ee-c31ed2f7f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:47.479638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d226a4-16c7-4f34-93b9-4e53232f5f76 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:47.519198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5872b4-59d2-4188-8e38-3bbf461ab66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:47.520068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5872b4-59d2-4188-8e38-3bbf461ab66f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:47.520594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5872b4-59d2-4188-8e38-3bbf461ab66f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:47.521016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5872b4-59d2-4188-8e38-3bbf461ab66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:47.521951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5872b4-59d2-4188-8e38-3bbf461ab66f None admin] RBAC: Adding query filter params (role.id=6bf2c10dc09a4e9087fd12312566376f, user.id=8240019a9313476580d712c19891d7c5, scope.system=all) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:47.522409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5872b4-59d2-4188-8e38-3bbf461ab66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:47.524022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5872b4-59d2-4188-8e38-3bbf461ab66f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:47.530135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 139/280] 10.222.0.81 () {56 vars in 1308 bytes} [Thu Aug 18 16:50:47 2022] GET /identity/v3/role_assignments?user.id=8240019a9313476580d712c19891d7c5&scope.system=all&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:47.540510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 142/281] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:47.646899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff257d-110e-4bdd-82f9-87a683795bd5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:47.647558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff257d-110e-4bdd-82f9-87a683795bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:47.648035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff257d-110e-4bdd-82f9-87a683795bd5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:47.650039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 140/282] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:47.655953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922d431-21b3-4f8b-a832-be08e7c0d1d0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:47.656606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922d431-21b3-4f8b-a832-be08e7c0d1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:47.657173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922d431-21b3-4f8b-a832-be08e7c0d1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:47.678011 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3922d431-21b3-4f8b-a832-be08e7c0d1d0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:47.679211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3922d431-21b3-4f8b-a832-be08e7c0d1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:47.756721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 143/283] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:47.805316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff257d-110e-4bdd-82f9-87a683795bd5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:47.936518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff257d-110e-4bdd-82f9-87a683795bd5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:47.965097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:47.993103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ad058-f98d-4cd4-af2e-520181a984ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:47.994060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ad058-f98d-4cd4-af2e-520181a984ce None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:47.994561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ad058-f98d-4cd4-af2e-520181a984ce None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:47.995054 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ad058-f98d-4cd4-af2e-520181a984ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:48.011532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ad058-f98d-4cd4-af2e-520181a984ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-813ad058-f98d-4cd4-af2e-520181a984ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:48.016474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:48.017395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:48.019013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 141/284] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:48.026025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922d431-21b3-4f8b-a832-be08e7c0d1d0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:48.072503 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:48.104401 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ad058-f98d-4cd4-af2e-520181a984ce None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:48.162585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922d431-21b3-4f8b-a832-be08e7c0d1d0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:48.208363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca8a4a-beca-4bd9-a8f5-6730c93b1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:48.210960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca8a4a-beca-4bd9-a8f5-6730c93b1e90 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:48.211438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca8a4a-beca-4bd9-a8f5-6730c93b1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:48.211920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca8a4a-beca-4bd9-a8f5-6730c93b1e90 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:48.212827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca8a4a-beca-4bd9-a8f5-6730c93b1e90 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:48.214714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca8a4a-beca-4bd9-a8f5-6730c93b1e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:48.216573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca8a4a-beca-4bd9-a8f5-6730c93b1e90 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:48.243272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 144/285] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:48.253519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca8a4a-beca-4bd9-a8f5-6730c93b1e90 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:48.281773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ad058-f98d-4cd4-af2e-520181a984ce None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:48.339997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5235-6ea7-4a68-bfbb-6e39142ec19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:48.340699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5235-6ea7-4a68-bfbb-6e39142ec19c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:48.340982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5235-6ea7-4a68-bfbb-6e39142ec19c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:48.341259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5235-6ea7-4a68-bfbb-6e39142ec19c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:48.367218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5235-6ea7-4a68-bfbb-6e39142ec19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e13a5235-6ea7-4a68-bfbb-6e39142ec19c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:48.372511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:48.373534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:48.374369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 142/286] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:48.380231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5235-6ea7-4a68-bfbb-6e39142ec19c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:48.406170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:48.416703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca8a4a-beca-4bd9-a8f5-6730c93b1e90 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:48.461322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab69a0-3db8-4003-96c2-4002c8391c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:48.462790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab69a0-3db8-4003-96c2-4002c8391c6f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:48.463571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab69a0-3db8-4003-96c2-4002c8391c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:48.464390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab69a0-3db8-4003-96c2-4002c8391c6f None admin] PATH_INFO: `/v3/users/fa3d580b225d45f08c9998f5bf37a624` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:48.466795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab69a0-3db8-4003-96c2-4002c8391c6f None admin] RBAC: Authorizing `identity:get_user(user_id=fa3d580b225d45f08c9998f5bf37a624)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:48.469862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab69a0-3db8-4003-96c2-4002c8391c6f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:48.473742 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 145/287] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:48 2022] GET /identity/v3/users/fa3d580b225d45f08c9998f5bf37a624 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:48.479132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:48.481613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab69a0-3db8-4003-96c2-4002c8391c6f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:48.547066 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5235-6ea7-4a68-bfbb-6e39142ec19c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:48.614623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8ef6-7b9c-4dd2-bd44-78c4387eecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:48.616430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8ef6-7b9c-4dd2-bd44-78c4387eecf4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:48.617259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8ef6-7b9c-4dd2-bd44-78c4387eecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:48.618052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8ef6-7b9c-4dd2-bd44-78c4387eecf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:48.619637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d8ef6-7b9c-4dd2-bd44-78c4387eecf4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:48.620490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d8ef6-7b9c-4dd2-bd44-78c4387eecf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:48.632493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d8ef6-7b9c-4dd2-bd44-78c4387eecf4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:48.647175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 143/288] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:48.648028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab69a0-3db8-4003-96c2-4002c8391c6f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:48.648697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8ef6-7b9c-4dd2-bd44-78c4387eecf4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:48.684008 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fb4ba-f3d2-4e3b-ad54-8880923b8158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:48.684696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb4ba-f3d2-4e3b-ad54-8880923b8158 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:48.684978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb4ba-f3d2-4e3b-ad54-8880923b8158 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:48.685253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb4ba-f3d2-4e3b-ad54-8880923b8158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:48.728497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:48.769683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fb4ba-f3d2-4e3b-ad54-8880923b8158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:48.771206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fb4ba-f3d2-4e3b-ad54-8880923b8158 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:48.862120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8ef6-7b9c-4dd2-bd44-78c4387eecf4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:48.865172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:48.924134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 146/289] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:48.936085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fb4ba-f3d2-4e3b-ad54-8880923b8158 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:48.952314 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35ca3b-712a-413e-94c1-c68701d1de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:48.953261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ca3b-712a-413e-94c1-c68701d1de45 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:48.953723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ca3b-712a-413e-94c1-c68701d1de45 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:48.954142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ca3b-712a-413e-94c1-c68701d1de45 None admin] PATH_INFO: `/v3/users/1133436059f04feaa446ddfe3b7d6f74` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:48.958425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35ca3b-712a-413e-94c1-c68701d1de45 None admin] RBAC: Authorizing `identity:get_user(user_id=1133436059f04feaa446ddfe3b7d6f74)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:48.960540 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35ca3b-712a-413e-94c1-c68701d1de45 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:48.965477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 144/290] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:48 2022] GET /identity/v3/users/1133436059f04feaa446ddfe3b7d6f74 => generated 297 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:48.970044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35ca3b-712a-413e-94c1-c68701d1de45 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:49.079756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:49.147000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35ca3b-712a-413e-94c1-c68701d1de45 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:49.164662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fb4ba-f3d2-4e3b-ad54-8880923b8158 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:49.185722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c5fd-5dae-448e-a982-6feade44c960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:49.186370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c5fd-5dae-448e-a982-6feade44c960 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:49.186691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c5fd-5dae-448e-a982-6feade44c960 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:49.187155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c5fd-5dae-448e-a982-6feade44c960 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:49.188635 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c5fd-5dae-448e-a982-6feade44c960 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:49.190264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c5fd-5dae-448e-a982-6feade44c960 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:49.192522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 145/291] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:48 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:49.198377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c5fd-5dae-448e-a982-6feade44c960 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:49.221714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141199f8-e41f-4980-a749-b06d3b1322b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:49.222367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141199f8-e41f-4980-a749-b06d3b1322b0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:49.222647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141199f8-e41f-4980-a749-b06d3b1322b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:49.222920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141199f8-e41f-4980-a749-b06d3b1322b0 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:49.224661 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141199f8-e41f-4980-a749-b06d3b1322b0 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:49.226132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141199f8-e41f-4980-a749-b06d3b1322b0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:49.228107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 147/292] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:48 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:49.236626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141199f8-e41f-4980-a749-b06d3b1322b0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:49.316835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:49.371473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141199f8-e41f-4980-a749-b06d3b1322b0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:49.406170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:49.429666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d18ed-6169-472f-a063-b8dbf292e650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:49.430343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d18ed-6169-472f-a063-b8dbf292e650 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:49.430780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d18ed-6169-472f-a063-b8dbf292e650 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:49.431199 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d18ed-6169-472f-a063-b8dbf292e650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:49.432050 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d18ed-6169-472f-a063-b8dbf292e650 None admin] RBAC: Adding query filter params (role.id=6bf2c10dc09a4e9087fd12312566376f, scope.project.id=b872016c0ae541aab80d335607224572, user.id=fa3d580b225d45f08c9998f5bf37a624) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:49.432362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d18ed-6169-472f-a063-b8dbf292e650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:49.433864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d18ed-6169-472f-a063-b8dbf292e650 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:49.446072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 148/293] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:49 2022] GET /identity/v3/role_assignments?user.id=fa3d580b225d45f08c9998f5bf37a624&scope.project.id=b872016c0ae541aab80d335607224572&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:49.485790 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c5fd-5dae-448e-a982-6feade44c960 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:49.541158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f3b1f-eee8-4bf5-bd58-0298534a673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:49.542055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f3b1f-eee8-4bf5-bd58-0298534a673b None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:49.542359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f3b1f-eee8-4bf5-bd58-0298534a673b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:49.542848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f3b1f-eee8-4bf5-bd58-0298534a673b None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572/users/1133436059f04feaa446ddfe3b7d6f74/roles/abf1096d1164471f9a47ae942e516329` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:49.545550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f3b1f-eee8-4bf5-bd58-0298534a673b None admin] RBAC: Authorizing `identity:create_grant(project_id=b872016c0ae541aab80d335607224572, user_id=1133436059f04feaa446ddfe3b7d6f74, role_id=abf1096d1164471f9a47ae942e516329)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:49.548348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f3b1f-eee8-4bf5-bd58-0298534a673b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:49.571537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 146/294] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:50:49 2022] PUT /identity/v3/projects/b872016c0ae541aab80d335607224572/users/1133436059f04feaa446ddfe3b7d6f74/roles/abf1096d1164471f9a47ae942e516329 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:50:49.683468 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c005e-dd5a-4ed8-832c-c34e4e9f0327 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:49.683980 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c005e-dd5a-4ed8-832c-c34e4e9f0327 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:49.684480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c005e-dd5a-4ed8-832c-c34e4e9f0327 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:49.686257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 149/295] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:49.692744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944fda-6d02-40e6-921f-13c5693cc81c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:49.693138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944fda-6d02-40e6-921f-13c5693cc81c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:49.693420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944fda-6d02-40e6-921f-13c5693cc81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:49.723399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5e944fda-6d02-40e6-921f-13c5693cc81c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:49.724826 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5e944fda-6d02-40e6-921f-13c5693cc81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:49.808183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 147/296] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:49.978376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a30936-c52b-4b02-9867-7613a885d675 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:49.979061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a30936-c52b-4b02-9867-7613a885d675 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:49.979560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a30936-c52b-4b02-9867-7613a885d675 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:49.981263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 150/297] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:49.987739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b95278-e744-428b-acfa-5ec8e5acbc89 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:49.988092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b95278-e744-428b-acfa-5ec8e5acbc89 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:49.988373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b95278-e744-428b-acfa-5ec8e5acbc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:50.015064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-76b95278-e744-428b-acfa-5ec8e5acbc89 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:50.016325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-76b95278-e744-428b-acfa-5ec8e5acbc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:50.047122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:50.107138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 148/298] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:50.133817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a30936-c52b-4b02-9867-7613a885d675 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:50.260243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a30936-c52b-4b02-9867-7613a885d675 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:50.304384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75b8dc-c930-4844-a473-f53d7a7d7196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:50.305049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75b8dc-c930-4844-a473-f53d7a7d7196 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:50.305327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75b8dc-c930-4844-a473-f53d7a7d7196 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:50.305603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75b8dc-c930-4844-a473-f53d7a7d7196 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:50.313239 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84784c8d-d7d0-459a-b5ec-6dfc9cc536be None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:50.313634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84784c8d-d7d0-459a-b5ec-6dfc9cc536be None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:50.313786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84784c8d-d7d0-459a-b5ec-6dfc9cc536be None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:50.316076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 149/299] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:50.322097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70a7a-1243-434d-bf87-e50cd1ebbb8f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:50.323050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70a7a-1243-434d-bf87-e50cd1ebbb8f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:50.323050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70a7a-1243-434d-bf87-e50cd1ebbb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:50.327750 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75b8dc-c930-4844-a473-f53d7a7d7196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-af75b8dc-c930-4844-a473-f53d7a7d7196 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:50.339457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:50.340718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:50.341720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:50.342358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-42f70a7a-1243-434d-bf87-e50cd1ebbb8f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:50.343093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-42f70a7a-1243-434d-bf87-e50cd1ebbb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:50.344809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 151/300] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:50.352282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75b8dc-c930-4844-a473-f53d7a7d7196 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:50.413964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:50.428289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 150/301] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:50.432756 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f70a7a-1243-434d-bf87-e50cd1ebbb8f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:50.488349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75b8dc-c930-4844-a473-f53d7a7d7196 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:50.532299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dd8eb-3828-4c32-a4b0-48ebdf90e265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:50.533226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dd8eb-3828-4c32-a4b0-48ebdf90e265 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:50.534148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dd8eb-3828-4c32-a4b0-48ebdf90e265 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:50.534635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dd8eb-3828-4c32-a4b0-48ebdf90e265 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:50.535527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dd8eb-3828-4c32-a4b0-48ebdf90e265 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:50.536373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dd8eb-3828-4c32-a4b0-48ebdf90e265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:50.538403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dd8eb-3828-4c32-a4b0-48ebdf90e265 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:50.550539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 152/302] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:50.553461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:50.556180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dd8eb-3828-4c32-a4b0-48ebdf90e265 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:50.566646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f70a7a-1243-434d-bf87-e50cd1ebbb8f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:50.608386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de993f7c-799f-453f-9df9-a4dfdbb4c40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:50.609563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993f7c-799f-453f-9df9-a4dfdbb4c40e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:50.610278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993f7c-799f-453f-9df9-a4dfdbb4c40e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:50.610442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993f7c-799f-453f-9df9-a4dfdbb4c40e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:50.623352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de993f7c-799f-453f-9df9-a4dfdbb4c40e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-de993f7c-799f-453f-9df9-a4dfdbb4c40e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:50.628862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:50.629791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:50.630590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 151/303] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:50.637509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de993f7c-799f-453f-9df9-a4dfdbb4c40e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:50.694125 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dd8eb-3828-4c32-a4b0-48ebdf90e265 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:50.711239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:50.745426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc8d59-4e3d-4c82-8dcc-f995fcaa28bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:50.746076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc8d59-4e3d-4c82-8dcc-f995fcaa28bd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:50.746364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc8d59-4e3d-4c82-8dcc-f995fcaa28bd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:50.746643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc8d59-4e3d-4c82-8dcc-f995fcaa28bd None admin] PATH_INFO: `/v3/users/8240019a9313476580d712c19891d7c5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:50.747795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc8d59-4e3d-4c82-8dcc-f995fcaa28bd None admin] RBAC: Authorizing `identity:get_user(user_id=8240019a9313476580d712c19891d7c5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:50.749317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc8d59-4e3d-4c82-8dcc-f995fcaa28bd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:50.751008 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 153/304] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:50 2022] GET /identity/v3/users/8240019a9313476580d712c19891d7c5 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:50.751862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc8d59-4e3d-4c82-8dcc-f995fcaa28bd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:50.772674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de993f7c-799f-453f-9df9-a4dfdbb4c40e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:50.813444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63749592-7d91-47d9-a215-6f752b7c4895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:50.814749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63749592-7d91-47d9-a215-6f752b7c4895 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:50.815124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63749592-7d91-47d9-a215-6f752b7c4895 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:50.815450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63749592-7d91-47d9-a215-6f752b7c4895 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:50.816120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63749592-7d91-47d9-a215-6f752b7c4895 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:50.816419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63749592-7d91-47d9-a215-6f752b7c4895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:50.817837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63749592-7d91-47d9-a215-6f752b7c4895 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:50.826575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 152/305] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:50.827412 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63749592-7d91-47d9-a215-6f752b7c4895 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:50.847052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:50.898203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc8d59-4e3d-4c82-8dcc-f995fcaa28bd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:50.937643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa0acb-9043-4112-91a3-b940acfe2781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:50.938284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa0acb-9043-4112-91a3-b940acfe2781 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:50.938595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa0acb-9043-4112-91a3-b940acfe2781 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:50.938893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa0acb-9043-4112-91a3-b940acfe2781 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:50.940591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa0acb-9043-4112-91a3-b940acfe2781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:50.942281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa0acb-9043-4112-91a3-b940acfe2781 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:50.948284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 154/306] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:50.948284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa0acb-9043-4112-91a3-b940acfe2781 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:50.952255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63749592-7d91-47d9-a215-6f752b7c4895 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:50.992991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fb95d-115b-415a-bd2e-e82399a583e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:50.993666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb95d-115b-415a-bd2e-e82399a583e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:50.993955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb95d-115b-415a-bd2e-e82399a583e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:50.994227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb95d-115b-415a-bd2e-e82399a583e0 None admin] PATH_INFO: `/v3/system/users/8240019a9313476580d712c19891d7c5/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:50.995677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fb95d-115b-415a-bd2e-e82399a583e0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8240019a9313476580d712c19891d7c5, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:50.997117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fb95d-115b-415a-bd2e-e82399a583e0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:51.008084 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 153/307] 10.222.0.81 () {58 vars in 1334 bytes} [Thu Aug 18 16:50:50 2022] PUT /identity/v3/system/users/8240019a9313476580d712c19891d7c5/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:51.008981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fb95d-115b-415a-bd2e-e82399a583e0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:51.023166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:51.096760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa0acb-9043-4112-91a3-b940acfe2781 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:51.117923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:51.137400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dc0d6-8ac7-4d6f-a81e-5164261d63ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:51.138218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dc0d6-8ac7-4d6f-a81e-5164261d63ac None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:51.138600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dc0d6-8ac7-4d6f-a81e-5164261d63ac None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:51.138951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dc0d6-8ac7-4d6f-a81e-5164261d63ac None admin] PATH_INFO: `/v3/users/ac964ed901c542528af31077aa57079b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:51.152414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fb95d-115b-415a-bd2e-e82399a583e0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:51.156981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dc0d6-8ac7-4d6f-a81e-5164261d63ac None admin] RBAC: Authorizing `identity:get_user(user_id=ac964ed901c542528af31077aa57079b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:51.158687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dc0d6-8ac7-4d6f-a81e-5164261d63ac None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:51.160642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 155/308] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:50 2022] GET /identity/v3/users/ac964ed901c542528af31077aa57079b => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:51.170471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dc0d6-8ac7-4d6f-a81e-5164261d63ac None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:51.200320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0471f87-768e-4016-a97e-6d623e50c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:51.201051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0471f87-768e-4016-a97e-6d623e50c3d0 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:51.201333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0471f87-768e-4016-a97e-6d623e50c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:51.201613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0471f87-768e-4016-a97e-6d623e50c3d0 None admin] PATH_INFO: `/v3/groups` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:51.202239 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0471f87-768e-4016-a97e-6d623e50c3d0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:51.203694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0471f87-768e-4016-a97e-6d623e50c3d0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:51.224364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 154/309] 10.222.0.81 () {60 vars in 1134 bytes} [Thu Aug 18 16:50:51 2022] POST /identity/v3/groups => generated 229 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:50:51.301238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dc0d6-8ac7-4d6f-a81e-5164261d63ac None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:51.313151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:51.342107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae47038-d129-4006-a5de-7c2891a5fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:51.342748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae47038-d129-4006-a5de-7c2891a5fac6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:51.343027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae47038-d129-4006-a5de-7c2891a5fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:51.343297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae47038-d129-4006-a5de-7c2891a5fac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:51.344052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae47038-d129-4006-a5de-7c2891a5fac6 None admin] RBAC: Adding query filter params (role.id=abf1096d1164471f9a47ae942e516329, user.id=ac964ed901c542528af31077aa57079b, scope.system=all) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:51.344362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae47038-d129-4006-a5de-7c2891a5fac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:51.346621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae47038-d129-4006-a5de-7c2891a5fac6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:51.353284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 156/310] 10.222.0.81 () {56 vars in 1308 bytes} [Thu Aug 18 16:50:51 2022] GET /identity/v3/role_assignments?user.id=ac964ed901c542528af31077aa57079b&scope.system=all&role.id=abf1096d1164471f9a47ae942e516329 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:50:51.732977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212ee94-d758-4179-bdcf-4715fe4a90c7 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:51.733534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212ee94-d758-4179-bdcf-4715fe4a90c7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:51.733534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212ee94-d758-4179-bdcf-4715fe4a90c7 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:51.741640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 155/311] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:51.747423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40041f55-a765-4251-8e89-a7df811c288f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:51.748006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40041f55-a765-4251-8e89-a7df811c288f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:51.748524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40041f55-a765-4251-8e89-a7df811c288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:51.778943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-40041f55-a765-4251-8e89-a7df811c288f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:51.780573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-40041f55-a765-4251-8e89-a7df811c288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:51.853809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 157/312] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:52.130141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212ee94-d758-4179-bdcf-4715fe4a90c7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:52.242454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212ee94-d758-4179-bdcf-4715fe4a90c7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:52.286477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d38912-ba9b-450f-b0f4-9f7ab313e2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:52.287821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d38912-ba9b-450f-b0f4-9f7ab313e2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:52.288383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d38912-ba9b-450f-b0f4-9f7ab313e2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:52.289217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d38912-ba9b-450f-b0f4-9f7ab313e2b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:52.293573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:52.310808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d38912-ba9b-450f-b0f4-9f7ab313e2b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-78d38912-ba9b-450f-b0f4-9f7ab313e2b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:52.319332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:52.321163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:52.322201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:52.325722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 156/313] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:52.331879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40041f55-a765-4251-8e89-a7df811c288f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:52.441602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40041f55-a765-4251-8e89-a7df811c288f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:52.444845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:52.478715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cd336-cfd1-48ea-93fb-bd28a9d1a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:52.479332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cd336-cfd1-48ea-93fb-bd28a9d1a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:52.479612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cd336-cfd1-48ea-93fb-bd28a9d1a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:52.479883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cd336-cfd1-48ea-93fb-bd28a9d1a2b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:52.480615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cd336-cfd1-48ea-93fb-bd28a9d1a2b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:52.480921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cd336-cfd1-48ea-93fb-bd28a9d1a2b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:52.482300 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cd336-cfd1-48ea-93fb-bd28a9d1a2b1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:52.491842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 158/314] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:52.497459 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d38912-ba9b-450f-b0f4-9f7ab313e2b7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:52.627791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d38912-ba9b-450f-b0f4-9f7ab313e2b7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:52.672397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ec4ed-5501-47b1-b17f-0b1d3d544260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:52.674396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec4ed-5501-47b1-b17f-0b1d3d544260 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:52.675085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec4ed-5501-47b1-b17f-0b1d3d544260 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:52.675798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ec4ed-5501-47b1-b17f-0b1d3d544260 None admin] PATH_INFO: `/v3/users/1133436059f04feaa446ddfe3b7d6f74` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:52.677864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ec4ed-5501-47b1-b17f-0b1d3d544260 None admin] RBAC: Authorizing `identity:get_user(user_id=1133436059f04feaa446ddfe3b7d6f74)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:52.679894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ec4ed-5501-47b1-b17f-0b1d3d544260 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:52.682308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 157/315] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:52 2022] GET /identity/v3/users/1133436059f04feaa446ddfe3b7d6f74 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:52.688829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cd336-cfd1-48ea-93fb-bd28a9d1a2b1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:52.801315 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cd336-cfd1-48ea-93fb-bd28a9d1a2b1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:52.837955 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ec94f-9906-43dd-9492-15191beb5eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:52.838588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ec94f-9906-43dd-9492-15191beb5eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:52.838866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ec94f-9906-43dd-9492-15191beb5eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:52.839140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ec94f-9906-43dd-9492-15191beb5eb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:52.874045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:52.916629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ec94f-9906-43dd-9492-15191beb5eb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:52.918114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ec94f-9906-43dd-9492-15191beb5eb9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:53.031860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 159/316] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:53.038326 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ec4ed-5501-47b1-b17f-0b1d3d544260 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:53.101797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9dce-4619-465a-8819-b66060ab0c22 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.102132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9dce-4619-465a-8819-b66060ab0c22 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.102360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9dce-4619-465a-8819-b66060ab0c22 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:53.103856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 160/317] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:53.113111 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:53.114100 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033aaff-1fc8-4c99-bd6a-528d9fcbaf0b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.114457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033aaff-1fc8-4c99-bd6a-528d9fcbaf0b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.114741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033aaff-1fc8-4c99-bd6a-528d9fcbaf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:53.140298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9033aaff-1fc8-4c99-bd6a-528d9fcbaf0b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:53.142137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9033aaff-1fc8-4c99-bd6a-528d9fcbaf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:53.172265 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ec4ed-5501-47b1-b17f-0b1d3d544260 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:53.224851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f64b4c-795c-4c05-91f5-cfc1ad5c55e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:53.225660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f64b4c-795c-4c05-91f5-cfc1ad5c55e9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.226065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f64b4c-795c-4c05-91f5-cfc1ad5c55e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.226479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f64b4c-795c-4c05-91f5-cfc1ad5c55e9 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:53.228007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f64b4c-795c-4c05-91f5-cfc1ad5c55e9 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:53.230897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f64b4c-795c-4c05-91f5-cfc1ad5c55e9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:53.234692 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:53.234886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 158/318] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:53 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:53.245757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f64b4c-795c-4c05-91f5-cfc1ad5c55e9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:53.249689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 161/319] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:53.371689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f64b4c-795c-4c05-91f5-cfc1ad5c55e9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:53.404922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:53.409798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81a27-1f93-4a69-8568-9f8c8d8d4dbb None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.410402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81a27-1f93-4a69-8568-9f8c8d8d4dbb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.410634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff81a27-1f93-4a69-8568-9f8c8d8d4dbb None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:53.414381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 162/320] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:50:53.417937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32215-5dff-4280-a564-318fc54d8625 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.418222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32215-5dff-4280-a564-318fc54d8625 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.418589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32215-5dff-4280-a564-318fc54d8625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:53.420282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765746d-3168-44ab-a30f-251c6f5d044a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:53.421287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765746d-3168-44ab-a30f-251c6f5d044a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.421784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765746d-3168-44ab-a30f-251c6f5d044a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.422308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765746d-3168-44ab-a30f-251c6f5d044a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:53.423250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765746d-3168-44ab-a30f-251c6f5d044a None admin] RBAC: Adding query filter params (role.id=abf1096d1164471f9a47ae942e516329, scope.project.id=b872016c0ae541aab80d335607224572, user.id=1133436059f04feaa446ddfe3b7d6f74) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:53.424347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765746d-3168-44ab-a30f-251c6f5d044a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:53.426063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765746d-3168-44ab-a30f-251c6f5d044a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:53.432825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 159/321] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:50:53 2022] GET /identity/v3/role_assignments?user.id=1133436059f04feaa446ddfe3b7d6f74&scope.project.id=b872016c0ae541aab80d335607224572&role.id=abf1096d1164471f9a47ae942e516329 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:53.434141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ff7a8-82c0-45dc-99ca-3f90d9d89abe None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.434405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ff7a8-82c0-45dc-99ca-3f90d9d89abe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.434514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ff7a8-82c0-45dc-99ca-3f90d9d89abe None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:53.436224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 160/322] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:53.442186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3a09-0d2b-4dd1-ba1a-c3a9c9dfce32 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.442712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3a09-0d2b-4dd1-ba1a-c3a9c9dfce32 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.442838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5dd32215-5dff-4280-a564-318fc54d8625 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:53.442981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f3a09-0d2b-4dd1-ba1a-c3a9c9dfce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:53.448751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5dd32215-5dff-4280-a564-318fc54d8625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:53.464097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0e1f3a09-0d2b-4dd1-ba1a-c3a9c9dfce32 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:53.465405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0e1f3a09-0d2b-4dd1-ba1a-c3a9c9dfce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:53.553622 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 163/323] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:53.558284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32215-5dff-4280-a564-318fc54d8625 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:53.560917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 161/324] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:53.671358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32215-5dff-4280-a564-318fc54d8625 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:53.697786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:53.711126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320968a-4171-4ca6-853f-b2159e323ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:53.711761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320968a-4171-4ca6-853f-b2159e323ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.712046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320968a-4171-4ca6-853f-b2159e323ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.712316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320968a-4171-4ca6-853f-b2159e323ba2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:53.726605 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320968a-4171-4ca6-853f-b2159e323ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7320968a-4171-4ca6-853f-b2159e323ba2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:53.736504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:53.737544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:53.738373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 164/325] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:53.743573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f3a09-0d2b-4dd1-ba1a-c3a9c9dfce32 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:53.824645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320968a-4171-4ca6-853f-b2159e323ba2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:53.874730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f3a09-0d2b-4dd1-ba1a-c3a9c9dfce32 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:53.902632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:53.913203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4074-c093-4074-acfe-e2cdf71b1ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:53.913823 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4074-c093-4074-acfe-e2cdf71b1ead None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.914104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4074-c093-4074-acfe-e2cdf71b1ead None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.914378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c4074-c093-4074-acfe-e2cdf71b1ead None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:53.915047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4074-c093-4074-acfe-e2cdf71b1ead None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:53.915351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4074-c093-4074-acfe-e2cdf71b1ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:53.916756 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c4074-c093-4074-acfe-e2cdf71b1ead None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:53.926334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 162/326] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:53.926808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4074-c093-4074-acfe-e2cdf71b1ead None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:53.935905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320968a-4171-4ca6-853f-b2159e323ba2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:53.982839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b1851-faf2-45df-8129-de2df349681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:53.983861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b1851-faf2-45df-8129-de2df349681e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:53.984342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b1851-faf2-45df-8129-de2df349681e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:53.984851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b1851-faf2-45df-8129-de2df349681e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:54.001392 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b1851-faf2-45df-8129-de2df349681e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-146b1851-faf2-45df-8129-de2df349681e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:54.010193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:54.011524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:54.012760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 165/327] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:54.014993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b1851-faf2-45df-8129-de2df349681e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:54.055883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c4074-c093-4074-acfe-e2cdf71b1ead None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:54.072336 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:54.091741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fa69e-5d7d-464c-bba8-5586d5a5fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:54.092385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fa69e-5d7d-464c-bba8-5586d5a5fe9f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:54.092698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fa69e-5d7d-464c-bba8-5586d5a5fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:54.092972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fa69e-5d7d-464c-bba8-5586d5a5fe9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:54.094104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fa69e-5d7d-464c-bba8-5586d5a5fe9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:54.096080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fa69e-5d7d-464c-bba8-5586d5a5fe9f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:54.097714 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 163/328] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:54.098462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fa69e-5d7d-464c-bba8-5586d5a5fe9f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:54.135255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b1851-faf2-45df-8129-de2df349681e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:54.160163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:54.175799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c740a62-207e-4d37-9415-008ee1222b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:54.176612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740a62-207e-4d37-9415-008ee1222b7d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:54.176794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740a62-207e-4d37-9415-008ee1222b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:54.177138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c740a62-207e-4d37-9415-008ee1222b7d None admin] PATH_INFO: `/v3/users/8240019a9313476580d712c19891d7c5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:54.179516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c740a62-207e-4d37-9415-008ee1222b7d None admin] RBAC: Authorizing `identity:get_user(user_id=8240019a9313476580d712c19891d7c5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:54.179974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c740a62-207e-4d37-9415-008ee1222b7d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:54.181691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 166/329] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:54 2022] GET /identity/v3/users/8240019a9313476580d712c19891d7c5 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:54.186826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c740a62-207e-4d37-9415-008ee1222b7d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:54.213309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fa69e-5d7d-464c-bba8-5586d5a5fe9f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:54.248389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da5bbd-4cc6-4a05-83b7-66d8061ba90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:54.249040 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da5bbd-4cc6-4a05-83b7-66d8061ba90c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:54.249327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da5bbd-4cc6-4a05-83b7-66d8061ba90c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:54.249613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da5bbd-4cc6-4a05-83b7-66d8061ba90c None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:54.250311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da5bbd-4cc6-4a05-83b7-66d8061ba90c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:54.250618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da5bbd-4cc6-4a05-83b7-66d8061ba90c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:54.252636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da5bbd-4cc6-4a05-83b7-66d8061ba90c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:54.261389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 164/330] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:54.262230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da5bbd-4cc6-4a05-83b7-66d8061ba90c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:54.287157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c740a62-207e-4d37-9415-008ee1222b7d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:54.301438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:54.328738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce191eba-bf2d-4d7f-b6bd-051a7049adf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:54.329351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce191eba-bf2d-4d7f-b6bd-051a7049adf4 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:54.329691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce191eba-bf2d-4d7f-b6bd-051a7049adf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:54.329973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce191eba-bf2d-4d7f-b6bd-051a7049adf4 None admin] PATH_INFO: `/v3/groups` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:54.330604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce191eba-bf2d-4d7f-b6bd-051a7049adf4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:54.332078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce191eba-bf2d-4d7f-b6bd-051a7049adf4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:54.348686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 167/331] 10.222.0.81 () {60 vars in 1134 bytes} [Thu Aug 18 16:50:54 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:50:54.349350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce191eba-bf2d-4d7f-b6bd-051a7049adf4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:54.383725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da5bbd-4cc6-4a05-83b7-66d8061ba90c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:54.404770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:54.429002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd075e-535c-4c0b-812b-cb32a8972a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:54.429503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd075e-535c-4c0b-812b-cb32a8972a9e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:54.429769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd075e-535c-4c0b-812b-cb32a8972a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:54.430046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd075e-535c-4c0b-812b-cb32a8972a9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:54.430801 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd075e-535c-4c0b-812b-cb32a8972a9e None admin] RBAC: Adding query filter params (role.id=6bf2c10dc09a4e9087fd12312566376f, user.id=8240019a9313476580d712c19891d7c5, scope.system=all) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:54.431107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd075e-535c-4c0b-812b-cb32a8972a9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:54.432910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd075e-535c-4c0b-812b-cb32a8972a9e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:54.456492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 165/332] 10.222.0.81 () {56 vars in 1308 bytes} [Thu Aug 18 16:50:54 2022] GET /identity/v3/role_assignments?user.id=8240019a9313476580d712c19891d7c5&scope.system=all&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:54.502566 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce191eba-bf2d-4d7f-b6bd-051a7049adf4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:54.547944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f5d4c-e45f-4a77-96ba-2b339fbe7d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:54.549239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5d4c-e45f-4a77-96ba-2b339fbe7d79 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:54.549560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5d4c-e45f-4a77-96ba-2b339fbe7d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:54.549893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5d4c-e45f-4a77-96ba-2b339fbe7d79 None admin] PATH_INFO: `/v3/users/ac964ed901c542528af31077aa57079b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:54.551181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f5d4c-e45f-4a77-96ba-2b339fbe7d79 None admin] RBAC: Authorizing `identity:get_user(user_id=ac964ed901c542528af31077aa57079b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:54.552728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f5d4c-e45f-4a77-96ba-2b339fbe7d79 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:54.554583 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 168/333] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:54 2022] GET /identity/v3/users/ac964ed901c542528af31077aa57079b => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:54.560641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd075e-535c-4c0b-812b-cb32a8972a9e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:54.683942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd075e-535c-4c0b-812b-cb32a8972a9e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:54.739310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b288c-b45b-4e97-8736-773da4431c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:54.740756 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b288c-b45b-4e97-8736-773da4431c75 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:54.741039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b288c-b45b-4e97-8736-773da4431c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:54.741315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b288c-b45b-4e97-8736-773da4431c75 None admin] PATH_INFO: `/v3/system/users/ac964ed901c542528af31077aa57079b/roles/abf1096d1164471f9a47ae942e516329` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:54.742779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b288c-b45b-4e97-8736-773da4431c75 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac964ed901c542528af31077aa57079b, role_id=abf1096d1164471f9a47ae942e516329)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:54.744178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b288c-b45b-4e97-8736-773da4431c75 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:54.753269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 166/334] 10.222.0.81 () {58 vars in 1334 bytes} [Thu Aug 18 16:50:54 2022] PUT /identity/v3/system/users/ac964ed901c542528af31077aa57079b/roles/abf1096d1164471f9a47ae942e516329 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:50:56.657177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17605b97-a13f-44ac-9944-c9805b207298 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:56.658179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17605b97-a13f-44ac-9944-c9805b207298 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:56.658697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17605b97-a13f-44ac-9944-c9805b207298 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:56.660658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 169/335] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:56.667413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bd212-4835-440d-ace0-a6420ff4ca0d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:56.668346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bd212-4835-440d-ace0-a6420ff4ca0d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:56.668858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bd212-4835-440d-ace0-a6420ff4ca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:56.689115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d19bd212-4835-440d-ace0-a6420ff4ca0d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:56.690688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d19bd212-4835-440d-ace0-a6420ff4ca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:56.744663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:56.754323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eb3d7-0468-460d-ad37-ee218169d679 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:56.754649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eb3d7-0468-460d-ad37-ee218169d679 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:56.754968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eb3d7-0468-460d-ad37-ee218169d679 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:56.756637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 170/336] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:56.765892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0485d-d1e7-4a18-8dd0-01083189b7d3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:56.766101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0485d-d1e7-4a18-8dd0-01083189b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:56.766314 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0485d-d1e7-4a18-8dd0-01083189b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:56.800089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 167/337] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:50:56.802465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-87c0485d-d1e7-4a18-8dd0-01083189b7d3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:56.803746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-87c0485d-d1e7-4a18-8dd0-01083189b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:56.857633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:56.911387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 171/338] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:57.319803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bd212-4835-440d-ace0-a6420ff4ca0d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:57.324983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171afd43-08e6-41a5-b268-180ac3b0ac7d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:57.325313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171afd43-08e6-41a5-b268-180ac3b0ac7d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:57.325622 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171afd43-08e6-41a5-b268-180ac3b0ac7d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:57.327307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 172/339] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:57.334382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b743c6-0708-47cf-a6f3-ef2352e64526 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:57.334817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b743c6-0708-47cf-a6f3-ef2352e64526 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:57.335015 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b743c6-0708-47cf-a6f3-ef2352e64526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:57.355208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-08b743c6-0708-47cf-a6f3-ef2352e64526 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:57.356581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-08b743c6-0708-47cf-a6f3-ef2352e64526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:57.478261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bd212-4835-440d-ace0-a6420ff4ca0d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:57.508921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 173/340] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:57.510646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b743c6-0708-47cf-a6f3-ef2352e64526 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:57.570284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742d1e9-c096-4400-966a-5288238c1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:57.571032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742d1e9-c096-4400-966a-5288238c1618 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:57.571321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742d1e9-c096-4400-966a-5288238c1618 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:57.571598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742d1e9-c096-4400-966a-5288238c1618 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:57.590490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742d1e9-c096-4400-966a-5288238c1618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f742d1e9-c096-4400-966a-5288238c1618 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:57.596637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:57.597555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:57.598377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:57.605306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 168/341] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:57.606428 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742d1e9-c096-4400-966a-5288238c1618 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:57.645716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:57.717559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:57.725867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b743c6-0708-47cf-a6f3-ef2352e64526 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:57.738364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742d1e9-c096-4400-966a-5288238c1618 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:57.787054 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fac3f8-f940-4402-9da6-9cb6498aa2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:57.788381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fac3f8-f940-4402-9da6-9cb6498aa2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:57.788852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fac3f8-f940-4402-9da6-9cb6498aa2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:57.789438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fac3f8-f940-4402-9da6-9cb6498aa2a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:57.790444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fac3f8-f940-4402-9da6-9cb6498aa2a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:57.791017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fac3f8-f940-4402-9da6-9cb6498aa2a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:57.792974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fac3f8-f940-4402-9da6-9cb6498aa2a0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:57.801560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252982f-2c91-423f-949e-5c108a858557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:57.802465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252982f-2c91-423f-949e-5c108a858557 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:57.802465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252982f-2c91-423f-949e-5c108a858557 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:57.803324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252982f-2c91-423f-949e-5c108a858557 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:57.811167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 169/342] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:57.817334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fac3f8-f940-4402-9da6-9cb6498aa2a0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:57.831106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252982f-2c91-423f-949e-5c108a858557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e252982f-2c91-423f-949e-5c108a858557 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:57.838034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:57.839163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:57.840152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:57.842951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 174/343] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:50:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:57.850663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252982f-2c91-423f-949e-5c108a858557 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:57.950574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:57.960551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fac3f8-f940-4402-9da6-9cb6498aa2a0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:58.006179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b8750-20f1-4474-aacd-e7f13ce54cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:58.006834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b8750-20f1-4474-aacd-e7f13ce54cea None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.007122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b8750-20f1-4474-aacd-e7f13ce54cea None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.007403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b8750-20f1-4474-aacd-e7f13ce54cea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.009662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252982f-2c91-423f-949e-5c108a858557 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:58.061008 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c9a4f-7fd9-434e-ac24-424a011b45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:58.062039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c9a4f-7fd9-434e-ac24-424a011b45a8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.062461 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c9a4f-7fd9-434e-ac24-424a011b45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.062876 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c9a4f-7fd9-434e-ac24-424a011b45a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.063764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c9a4f-7fd9-434e-ac24-424a011b45a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:58.064813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c9a4f-7fd9-434e-ac24-424a011b45a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:58.066574 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c9a4f-7fd9-434e-ac24-424a011b45a8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:58.082257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b8750-20f1-4474-aacd-e7f13ce54cea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:58.083143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 175/344] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:50:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:58.083698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b8750-20f1-4474-aacd-e7f13ce54cea None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:58.084789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e12ef-6a84-4946-91a9-59cbf7ca2230 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.085220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e12ef-6a84-4946-91a9-59cbf7ca2230 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.085662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e12ef-6a84-4946-91a9-59cbf7ca2230 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.087181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 176/345] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:58.088012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e12ef-6a84-4946-91a9-59cbf7ca2230 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:58.119222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:58.208718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:58.219121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 170/346] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:58.220625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f366-6357-4034-951b-485894b4dfa4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.220882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f366-6357-4034-951b-485894b4dfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.221164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91f366-6357-4034-951b-485894b4dfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.234764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e12ef-6a84-4946-91a9-59cbf7ca2230 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:58.246151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4b91f366-6357-4034-951b-485894b4dfa4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:58.247310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4b91f366-6357-4034-951b-485894b4dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:58.276899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce8b3-928c-42e7-bd6b-ae57dc1117f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:58.277945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce8b3-928c-42e7-bd6b-ae57dc1117f2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.278413 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce8b3-928c-42e7-bd6b-ae57dc1117f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.278870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce8b3-928c-42e7-bd6b-ae57dc1117f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.291239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ce8b3-928c-42e7-bd6b-ae57dc1117f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-873ce8b3-928c-42e7-bd6b-ae57dc1117f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:58.296666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:58.297616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 16:50:58.299111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:58.301663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 177/347] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:58.302734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce8b3-928c-42e7-bd6b-ae57dc1117f2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:58.327722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 171/348] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:58.328746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f366-6357-4034-951b-485894b4dfa4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:58.398416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:58.429346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce8b3-928c-42e7-bd6b-ae57dc1117f2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:58.474843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eea50e-2e68-41f9-b8c5-ddee29e0d69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:58.475814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea50e-2e68-41f9-b8c5-ddee29e0d69e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.476489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea50e-2e68-41f9-b8c5-ddee29e0d69e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.476966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eea50e-2e68-41f9-b8c5-ddee29e0d69e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.487674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91f366-6357-4034-951b-485894b4dfa4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:58.515644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:58.529538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d786f7-55e4-42d0-a4cd-0c98d3de573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:58.530192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d786f7-55e4-42d0-a4cd-0c98d3de573f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.530506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d786f7-55e4-42d0-a4cd-0c98d3de573f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.530763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d786f7-55e4-42d0-a4cd-0c98d3de573f None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.532438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d786f7-55e4-42d0-a4cd-0c98d3de573f None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:58.534180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d786f7-55e4-42d0-a4cd-0c98d3de573f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:58.535983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 172/349] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:58 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:58.539506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d786f7-55e4-42d0-a4cd-0c98d3de573f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:58.569423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eea50e-2e68-41f9-b8c5-ddee29e0d69e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:58.571348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eea50e-2e68-41f9-b8c5-ddee29e0d69e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:58.661387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d786f7-55e4-42d0-a4cd-0c98d3de573f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:58.668614 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:58.692148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 178/350] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:50:58.693967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30f7f7-f11f-4dc4-9a25-0eaded5cb5d5 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.694111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30f7f7-f11f-4dc4-9a25-0eaded5cb5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.694368 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30f7f7-f11f-4dc4-9a25-0eaded5cb5d5 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.696098 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 179/351] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:58.700489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30f7f7-f11f-4dc4-9a25-0eaded5cb5d5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:58.711210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed5498-cbc0-4f3b-86bc-a95b26da7cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:58.712155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed5498-cbc0-4f3b-86bc-a95b26da7cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.712437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed5498-cbc0-4f3b-86bc-a95b26da7cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.712744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed5498-cbc0-4f3b-86bc-a95b26da7cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.713633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed5498-cbc0-4f3b-86bc-a95b26da7cc4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:58.713943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed5498-cbc0-4f3b-86bc-a95b26da7cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:58.716078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed5498-cbc0-4f3b-86bc-a95b26da7cc4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:58.729432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 173/352] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:58.730324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed5498-cbc0-4f3b-86bc-a95b26da7cc4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:58.805560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:58.856140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30f7f7-f11f-4dc4-9a25-0eaded5cb5d5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:58.887011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed5498-cbc0-4f3b-86bc-a95b26da7cc4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:58.907317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457992a-6ab2-4ca7-acdc-b4134a6cb1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:58.908254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457992a-6ab2-4ca7-acdc-b4134a6cb1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.909423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457992a-6ab2-4ca7-acdc-b4134a6cb1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.909423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457992a-6ab2-4ca7-acdc-b4134a6cb1e8 None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.920546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457992a-6ab2-4ca7-acdc-b4134a6cb1e8 None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:58.923114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457992a-6ab2-4ca7-acdc-b4134a6cb1e8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:58.926528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 180/353] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:50:58 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:58.928162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b04bdd-196b-4910-bb98-80e94d2fed23 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.928548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b04bdd-196b-4910-bb98-80e94d2fed23 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.928920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b04bdd-196b-4910-bb98-80e94d2fed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.940759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff1d1b-d478-412b-8d57-b3e528335f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:58.941711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff1d1b-d478-412b-8d57-b3e528335f1a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:58.943146 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff1d1b-d478-412b-8d57-b3e528335f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:58.943146 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff1d1b-d478-412b-8d57-b3e528335f1a None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:58.943511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff1d1b-d478-412b-8d57-b3e528335f1a None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:58.945925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff1d1b-d478-412b-8d57-b3e528335f1a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:58.952505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 174/354] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:50:58 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:58.952505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff1d1b-d478-412b-8d57-b3e528335f1a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:58.959227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-52b04bdd-196b-4910-bb98-80e94d2fed23 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:58.960990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-52b04bdd-196b-4910-bb98-80e94d2fed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:59.018221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:59.054076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 181/355] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:59.061471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b04bdd-196b-4910-bb98-80e94d2fed23 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:59.083264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff1d1b-d478-412b-8d57-b3e528335f1a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:59.115163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:59.137786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6ad6b-37a4-47cc-8504-9bd7d4c56429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:59.137786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6ad6b-37a4-47cc-8504-9bd7d4c56429 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:59.137786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6ad6b-37a4-47cc-8504-9bd7d4c56429 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:59.137786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6ad6b-37a4-47cc-8504-9bd7d4c56429 None admin] PATH_INFO: `/v3/users/ac964ed901c542528af31077aa57079b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:59.138975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6ad6b-37a4-47cc-8504-9bd7d4c56429 None admin] RBAC: Authorizing `identity:get_user(user_id=ac964ed901c542528af31077aa57079b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:59.140783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6ad6b-37a4-47cc-8504-9bd7d4c56429 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:59.143250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 175/356] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:50:58 2022] GET /identity/v3/users/ac964ed901c542528af31077aa57079b => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:59.146742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6ad6b-37a4-47cc-8504-9bd7d4c56429 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:59.221538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b04bdd-196b-4910-bb98-80e94d2fed23 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:59.269088 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6ad6b-37a4-47cc-8504-9bd7d4c56429 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:59.290113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005055-b524-47df-af6a-00683e1390eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:59.290756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005055-b524-47df-af6a-00683e1390eb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:59.291042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005055-b524-47df-af6a-00683e1390eb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:59.291307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005055-b524-47df-af6a-00683e1390eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:59.309113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79005055-b524-47df-af6a-00683e1390eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-79005055-b524-47df-af6a-00683e1390eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:59.316224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:59.317380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 182/357] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:50:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:59.318190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005055-b524-47df-af6a-00683e1390eb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:59.335072 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c22d3-edd2-47ea-8438-bc5bf6047743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:59.336295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c22d3-edd2-47ea-8438-bc5bf6047743 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:59.336639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c22d3-edd2-47ea-8438-bc5bf6047743 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:59.336933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c22d3-edd2-47ea-8438-bc5bf6047743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:59.337669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c22d3-edd2-47ea-8438-bc5bf6047743 None admin] RBAC: Adding query filter params (group.id=30c80232afaa4c5b953d2dac4178778a, role.id=6bf2c10dc09a4e9087fd12312566376f, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:59.337986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c22d3-edd2-47ea-8438-bc5bf6047743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:59.340132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c22d3-edd2-47ea-8438-bc5bf6047743 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:59.347617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 176/358] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Aug 18 16:50:59 2022] GET /identity/v3/role_assignments?group.id=30c80232afaa4c5b953d2dac4178778a&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:59.348393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c22d3-edd2-47ea-8438-bc5bf6047743 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:59.384172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:59.419280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:59.486924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005055-b524-47df-af6a-00683e1390eb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:59.505456 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c22d3-edd2-47ea-8438-bc5bf6047743 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:59.532838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f5542-3428-4cea-9146-bdb40f2e4401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:59.533559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f5542-3428-4cea-9146-bdb40f2e4401 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:59.533842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f5542-3428-4cea-9146-bdb40f2e4401 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:59.534116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f5542-3428-4cea-9146-bdb40f2e4401 None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:59.535499 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f5542-3428-4cea-9146-bdb40f2e4401 None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:59.537019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f5542-3428-4cea-9146-bdb40f2e4401 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:59.539215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 183/359] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:50:59 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:59.540421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef225f-7c90-4d92-a55b-9dc376cff33b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:59.540732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef225f-7c90-4d92-a55b-9dc376cff33b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:59.541006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef225f-7c90-4d92-a55b-9dc376cff33b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:59.542443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 184/360] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:50:59.542995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef225f-7c90-4d92-a55b-9dc376cff33b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:59.550115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f879d-6130-4a44-839b-f5a19781d595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:59.550998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f879d-6130-4a44-839b-f5a19781d595 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:59.551425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f879d-6130-4a44-839b-f5a19781d595 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:59.551841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f879d-6130-4a44-839b-f5a19781d595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:59.552759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f879d-6130-4a44-839b-f5a19781d595 None admin] RBAC: Adding query filter params (role.id=abf1096d1164471f9a47ae942e516329, user.id=ac964ed901c542528af31077aa57079b, scope.system=all) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:59.553722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f879d-6130-4a44-839b-f5a19781d595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:59.555813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f879d-6130-4a44-839b-f5a19781d595 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:59.574021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 177/361] 10.222.0.81 () {56 vars in 1308 bytes} [Thu Aug 18 16:50:59 2022] GET /identity/v3/role_assignments?user.id=ac964ed901c542528af31077aa57079b&scope.system=all&role.id=abf1096d1164471f9a47ae942e516329 => generated 510 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:59.575323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f879d-6130-4a44-839b-f5a19781d595 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:59.724004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef225f-7c90-4d92-a55b-9dc376cff33b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:59.728358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:59.770756 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f879d-6130-4a44-839b-f5a19781d595 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:59.792104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:50:59.807220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28739a36-0d75-4900-b8c2-3353c7743d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:59.807889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28739a36-0d75-4900-b8c2-3353c7743d9e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:59.808178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28739a36-0d75-4900-b8c2-3353c7743d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:59.808469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28739a36-0d75-4900-b8c2-3353c7743d9e None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:59.809402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28739a36-0d75-4900-b8c2-3353c7743d9e None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:50:59.809834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28739a36-0d75-4900-b8c2-3353c7743d9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:50:59.812020 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28739a36-0d75-4900-b8c2-3353c7743d9e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:50:59.830683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898d000-76a1-4bec-a2c0-4de039341516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:50:59.830683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898d000-76a1-4bec-a2c0-4de039341516 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:59.830683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898d000-76a1-4bec-a2c0-4de039341516 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:59.830683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898d000-76a1-4bec-a2c0-4de039341516 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:59.831411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 185/362] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:50:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:50:59.831411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28739a36-0d75-4900-b8c2-3353c7743d9e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:50:59.847427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898d000-76a1-4bec-a2c0-4de039341516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0898d000-76a1-4bec-a2c0-4de039341516 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:50:59.852821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:50:59.853773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:50:59.854650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 178/363] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:50:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:50:59.855371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1f335-bf02-4803-9fe8-cb66eb60ef62 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:50:59.855953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1f335-bf02-4803-9fe8-cb66eb60ef62 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:50:59.855953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1f335-bf02-4803-9fe8-cb66eb60ef62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:50:59.876662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0dc1f335-bf02-4803-9fe8-cb66eb60ef62 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:50:59.877882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0dc1f335-bf02-4803-9fe8-cb66eb60ef62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:50:59.973720 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 179/364] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:50:59.974641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28739a36-0d75-4900-b8c2-3353c7743d9e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:50:59.975073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1f335-bf02-4803-9fe8-cb66eb60ef62 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:00.013538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388f195-c415-4581-8749-88780466f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:00.014113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f195-c415-4581-8749-88780466f0ef None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:00.014397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f195-c415-4581-8749-88780466f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:00.014672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f195-c415-4581-8749-88780466f0ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:00.015419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388f195-c415-4581-8749-88780466f0ef None admin] RBAC: Adding query filter params (group.id=30c80232afaa4c5b953d2dac4178778a, role.id=f196d84ade534597912f4ce3ca3f36ee, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:00.015736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388f195-c415-4581-8749-88780466f0ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:00.018327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388f195-c415-4581-8749-88780466f0ef None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:00.025431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 186/365] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Aug 18 16:50:59 2022] GET /identity/v3/role_assignments?group.id=30c80232afaa4c5b953d2dac4178778a&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=f196d84ade534597912f4ce3ca3f36ee => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:00.026278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388f195-c415-4581-8749-88780466f0ef None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:00.130851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:00.141051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:00.149678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1f335-bf02-4803-9fe8-cb66eb60ef62 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:00.228444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778543b6-c4a8-43ad-83d3-829dc796f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:00.229165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778543b6-c4a8-43ad-83d3-829dc796f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:00.230094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778543b6-c4a8-43ad-83d3-829dc796f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:00.230383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778543b6-c4a8-43ad-83d3-829dc796f5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:00.302811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388f195-c415-4581-8749-88780466f0ef None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:00.321602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778543b6-c4a8-43ad-83d3-829dc796f5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:00.323073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778543b6-c4a8-43ad-83d3-829dc796f5d7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:00.350821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42da4e6-8915-46a5-8a89-37086cc3be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:00.351442 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42da4e6-8915-46a5-8a89-37086cc3be29 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:00.351727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42da4e6-8915-46a5-8a89-37086cc3be29 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:00.352003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42da4e6-8915-46a5-8a89-37086cc3be29 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:00.352848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42da4e6-8915-46a5-8a89-37086cc3be29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:00.353157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42da4e6-8915-46a5-8a89-37086cc3be29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:00.354528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42da4e6-8915-46a5-8a89-37086cc3be29 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:00.365759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 187/366] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:00.366693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42da4e6-8915-46a5-8a89-37086cc3be29 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:00.456678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:00.462906 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 180/367] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:00.464645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778543b6-c4a8-43ad-83d3-829dc796f5d7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:00.476850 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:00.487356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42da4e6-8915-46a5-8a89-37086cc3be29 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:00.538216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44bc5-c385-4b2e-8053-a471247b2ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:00.539328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44bc5-c385-4b2e-8053-a471247b2ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:00.539621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44bc5-c385-4b2e-8053-a471247b2ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:00.540171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44bc5-c385-4b2e-8053-a471247b2ec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:00.555604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba44bc5-c385-4b2e-8053-a471247b2ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7ba44bc5-c385-4b2e-8053-a471247b2ec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:00.562164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:00.563115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:00.564510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 188/368] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:00.566157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44bc5-c385-4b2e-8053-a471247b2ec8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:00.600800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778543b6-c4a8-43ad-83d3-829dc796f5d7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:00.645111 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222344bd-515e-4544-b6f3-7766f3f399b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:00.645742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222344bd-515e-4544-b6f3-7766f3f399b2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:00.646068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222344bd-515e-4544-b6f3-7766f3f399b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:00.646350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222344bd-515e-4544-b6f3-7766f3f399b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:00.698163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44bc5-c385-4b2e-8053-a471247b2ec8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:00.724265 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:00.727166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222344bd-515e-4544-b6f3-7766f3f399b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:00.728776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222344bd-515e-4544-b6f3-7766f3f399b2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:00.752543 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926e81a-10d7-4a9d-95e9-53e27317e708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:00.753331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926e81a-10d7-4a9d-95e9-53e27317e708 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:00.753623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926e81a-10d7-4a9d-95e9-53e27317e708 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:00.753918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926e81a-10d7-4a9d-95e9-53e27317e708 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:00.759382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926e81a-10d7-4a9d-95e9-53e27317e708 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:00.761108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926e81a-10d7-4a9d-95e9-53e27317e708 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:00.763209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 189/369] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:00 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:00.764563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926e81a-10d7-4a9d-95e9-53e27317e708 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:00.790032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:00.841643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 181/370] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:00.842445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222344bd-515e-4544-b6f3-7766f3f399b2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:00.876879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926e81a-10d7-4a9d-95e9-53e27317e708 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:00.913840 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c55e1-4829-498c-a7e8-4d5a7fa1672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:00.914463 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c55e1-4829-498c-a7e8-4d5a7fa1672f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:00.914746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c55e1-4829-498c-a7e8-4d5a7fa1672f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:00.915024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c55e1-4829-498c-a7e8-4d5a7fa1672f None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:00.915698 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c55e1-4829-498c-a7e8-4d5a7fa1672f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:00.916005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c55e1-4829-498c-a7e8-4d5a7fa1672f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:00.917541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c55e1-4829-498c-a7e8-4d5a7fa1672f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:00.926842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 190/371] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:00.927712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c55e1-4829-498c-a7e8-4d5a7fa1672f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:00.953554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:00.958113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222344bd-515e-4544-b6f3-7766f3f399b2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:00.996132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6283ba-ace8-4364-8fd2-9149fc4f8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:00.997148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6283ba-ace8-4364-8fd2-9149fc4f8cea None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:00.997573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6283ba-ace8-4364-8fd2-9149fc4f8cea None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:00.997988 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6283ba-ace8-4364-8fd2-9149fc4f8cea None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:00.999268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6283ba-ace8-4364-8fd2-9149fc4f8cea None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:01.000891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6283ba-ace8-4364-8fd2-9149fc4f8cea None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:01.003226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 182/372] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:00 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:01.004128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6283ba-ace8-4364-8fd2-9149fc4f8cea None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:01.021320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:01.041082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c55e1-4829-498c-a7e8-4d5a7fa1672f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:01.079823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ec2ed-86f0-410e-bac8-d22b7c4ad349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:01.080500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ec2ed-86f0-410e-bac8-d22b7c4ad349 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:01.080789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ec2ed-86f0-410e-bac8-d22b7c4ad349 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:01.081066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ec2ed-86f0-410e-bac8-d22b7c4ad349 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:01.082310 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ec2ed-86f0-410e-bac8-d22b7c4ad349 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:01.083856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ec2ed-86f0-410e-bac8-d22b7c4ad349 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:01.085896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 191/373] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:00 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:01.086709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ec2ed-86f0-410e-bac8-d22b7c4ad349 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:01.123730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6283ba-ace8-4364-8fd2-9149fc4f8cea None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:01.162378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb7f11-71b7-4cc8-9c5a-97e18f538ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:01.163248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7f11-71b7-4cc8-9c5a-97e18f538ebc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:01.163702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7f11-71b7-4cc8-9c5a-97e18f538ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:01.164118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7f11-71b7-4cc8-9c5a-97e18f538ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:01.198088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ec2ed-86f0-410e-bac8-d22b7c4ad349 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:01.202889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:01.237497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ded94-9522-47ed-b77c-404a780ae6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:01.238125 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ded94-9522-47ed-b77c-404a780ae6ae None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:01.238411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ded94-9522-47ed-b77c-404a780ae6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:01.239171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ded94-9522-47ed-b77c-404a780ae6ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:01.239537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ded94-9522-47ed-b77c-404a780ae6ae None admin] RBAC: Adding query filter params (group.id=30c80232afaa4c5b953d2dac4178778a, role.id=6bf2c10dc09a4e9087fd12312566376f, scope.project.id=b872016c0ae541aab80d335607224572) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:01.239853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ded94-9522-47ed-b77c-404a780ae6ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:01.241592 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ded94-9522-47ed-b77c-404a780ae6ae None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:01.242133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb7f11-71b7-4cc8-9c5a-97e18f538ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:01.243752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb7f11-71b7-4cc8-9c5a-97e18f538ebc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:01.248223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 192/374] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Aug 18 16:51:01 2022] GET /identity/v3/role_assignments?group.id=30c80232afaa4c5b953d2dac4178778a&scope.project.id=b872016c0ae541aab80d335607224572&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:01.249164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ded94-9522-47ed-b77c-404a780ae6ae None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:01.292897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:01.376968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 183/375] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:01.383131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ded94-9522-47ed-b77c-404a780ae6ae None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:01.383354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb7f11-71b7-4cc8-9c5a-97e18f538ebc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:01.425677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062579f-b574-4d2d-9297-c0266906c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:01.426341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062579f-b574-4d2d-9297-c0266906c98a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:01.426628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062579f-b574-4d2d-9297-c0266906c98a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:01.426901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062579f-b574-4d2d-9297-c0266906c98a None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:01.428140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062579f-b574-4d2d-9297-c0266906c98a None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:01.429678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062579f-b574-4d2d-9297-c0266906c98a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:01.431373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 193/376] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:01 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:01.437410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062579f-b574-4d2d-9297-c0266906c98a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:01.463913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:01.549016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb7f11-71b7-4cc8-9c5a-97e18f538ebc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:01.550659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:01.571959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062579f-b574-4d2d-9297-c0266906c98a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:01.598648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacd4f9-8c9b-4265-bbdd-29ec74bb4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:01.599666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacd4f9-8c9b-4265-bbdd-29ec74bb4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:01.600176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacd4f9-8c9b-4265-bbdd-29ec74bb4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:01.600693 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacd4f9-8c9b-4265-bbdd-29ec74bb4bd9 None admin] PATH_INFO: `/v3/projects/45c851fba36042bc85eb05b39752f169` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:01.602107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacd4f9-8c9b-4265-bbdd-29ec74bb4bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=45c851fba36042bc85eb05b39752f169)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:01.605700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacd4f9-8c9b-4265-bbdd-29ec74bb4bd9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:01.612509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 184/377] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:01 2022] GET /identity/v3/projects/45c851fba36042bc85eb05b39752f169 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:01.615875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacd4f9-8c9b-4265-bbdd-29ec74bb4bd9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:01.615988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18d91-7ad0-45da-bea4-3320a2204217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:01.615988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18d91-7ad0-45da-bea4-3320a2204217 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:01.616164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18d91-7ad0-45da-bea4-3320a2204217 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:01.616377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18d91-7ad0-45da-bea4-3320a2204217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:01.617066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18d91-7ad0-45da-bea4-3320a2204217 None admin] RBAC: Adding query filter params (group.id=30c80232afaa4c5b953d2dac4178778a, role.id=f196d84ade534597912f4ce3ca3f36ee, scope.project.id=b872016c0ae541aab80d335607224572) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:01.617375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18d91-7ad0-45da-bea4-3320a2204217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:01.618832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18d91-7ad0-45da-bea4-3320a2204217 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:01.627083 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 194/378] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Aug 18 16:51:01 2022] GET /identity/v3/role_assignments?group.id=30c80232afaa4c5b953d2dac4178778a&scope.project.id=b872016c0ae541aab80d335607224572&role.id=f196d84ade534597912f4ce3ca3f36ee => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:01.803159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacd4f9-8c9b-4265-bbdd-29ec74bb4bd9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:01.851690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72aaa6-f9ba-4b9a-94ef-87782b73557b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:01.852479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72aaa6-f9ba-4b9a-94ef-87782b73557b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:01.852670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72aaa6-f9ba-4b9a-94ef-87782b73557b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:01.852933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72aaa6-f9ba-4b9a-94ef-87782b73557b None admin] PATH_INFO: `/v3/groups/30a427c8a6fe4bbd95a0228d4de442f1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:01.860126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:01.864046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72aaa6-f9ba-4b9a-94ef-87782b73557b None admin] RBAC: Authorizing `identity:get_group(group_id=30a427c8a6fe4bbd95a0228d4de442f1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:01.865967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72aaa6-f9ba-4b9a-94ef-87782b73557b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:01.868185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 185/379] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:01 2022] GET /identity/v3/groups/30a427c8a6fe4bbd95a0228d4de442f1 => generated 229 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:01.874201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18d91-7ad0-45da-bea4-3320a2204217 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:01.887860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aab85-2622-46c0-b1d7-46258a8b993c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:01.888127 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aab85-2622-46c0-b1d7-46258a8b993c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:01.888341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aab85-2622-46c0-b1d7-46258a8b993c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:01.890187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 186/380] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:51:01.895419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95a27e-1ecb-4784-b511-d04bb7fb77b4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:01.895810 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95a27e-1ecb-4784-b511-d04bb7fb77b4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:01.896090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95a27e-1ecb-4784-b511-d04bb7fb77b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:01.928524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5f95a27e-1ecb-4784-b511-d04bb7fb77b4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:01.929835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5f95a27e-1ecb-4784-b511-d04bb7fb77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:01.994477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18d91-7ad0-45da-bea4-3320a2204217 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:02.038156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fa9e4-1954-4af5-aef9-c143168a74c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:02.039175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fa9e4-1954-4af5-aef9-c143168a74c1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:02.039175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fa9e4-1954-4af5-aef9-c143168a74c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:02.039469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fa9e4-1954-4af5-aef9-c143168a74c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:02.040188 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fa9e4-1954-4af5-aef9-c143168a74c1 None admin] RBAC: Adding query filter params (group.id=30a427c8a6fe4bbd95a0228d4de442f1, role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=45c851fba36042bc85eb05b39752f169) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:02.040535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fa9e4-1954-4af5-aef9-c143168a74c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:02.042066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fa9e4-1954-4af5-aef9-c143168a74c1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:02.058430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 195/381] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Aug 18 16:51:01 2022] GET /identity/v3/role_assignments?group.id=30a427c8a6fe4bbd95a0228d4de442f1&scope.project.id=45c851fba36042bc85eb05b39752f169&role.id=56228137a4444ef9b7e688d04abd00fd => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:02.066223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 187/382] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:51:02.375444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fa9e4-1954-4af5-aef9-c143168a74c1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:02.389177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:02.483454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc121ba4-640a-47e6-96fe-97adb9882ccf None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:02.483813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc121ba4-640a-47e6-96fe-97adb9882ccf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:02.484015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc121ba4-640a-47e6-96fe-97adb9882ccf None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:02.485536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 188/383] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:02.491389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4d834-bbfe-4696-b3e2-7d640df613c9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:02.491680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4d834-bbfe-4696-b3e2-7d640df613c9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:02.491962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4d834-bbfe-4696-b3e2-7d640df613c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:02.510389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9be4d834-bbfe-4696-b3e2-7d640df613c9 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:02.510848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fa9e4-1954-4af5-aef9-c143168a74c1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:02.511596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9be4d834-bbfe-4696-b3e2-7d640df613c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:02.573618 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135032-5d08-479c-a7c1-559becdf999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:02.574275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135032-5d08-479c-a7c1-559becdf999f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:02.574559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135032-5d08-479c-a7c1-559becdf999f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:02.574835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135032-5d08-479c-a7c1-559becdf999f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:02.596779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78135032-5d08-479c-a7c1-559becdf999f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-78135032-5d08-479c-a7c1-559becdf999f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:02.611241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:02.612294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:02.613130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 196/384] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:02.618392 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135032-5d08-479c-a7c1-559becdf999f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:02.642604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 189/385] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:02.708180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:02.757066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135032-5d08-479c-a7c1-559becdf999f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:02.801247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff1b39-759e-4556-a8a7-8b144701e082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:02.801888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1b39-759e-4556-a8a7-8b144701e082 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:02.802175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1b39-759e-4556-a8a7-8b144701e082 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:02.802452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1b39-759e-4556-a8a7-8b144701e082 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:02.803140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff1b39-759e-4556-a8a7-8b144701e082 None admin] RBAC: Adding query filter params (name=member) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:02.803501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff1b39-759e-4556-a8a7-8b144701e082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:02.805063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff1b39-759e-4556-a8a7-8b144701e082 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:02.815339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 197/386] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:51:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:02.822345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4d834-bbfe-4696-b3e2-7d640df613c9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:02.911184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:02.965025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4d834-bbfe-4696-b3e2-7d640df613c9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:03.010320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aea2ed-59f9-4d8a-8499-653a3f3086f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:03.011347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea2ed-59f9-4d8a-8499-653a3f3086f7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:03.011821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea2ed-59f9-4d8a-8499-653a3f3086f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:03.012288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aea2ed-59f9-4d8a-8499-653a3f3086f7 None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:03.017775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aea2ed-59f9-4d8a-8499-653a3f3086f7 None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:03.019732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aea2ed-59f9-4d8a-8499-653a3f3086f7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:03.021950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 190/387] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:02 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:03.027783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff1b39-759e-4556-a8a7-8b144701e082 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:03.169672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff1b39-759e-4556-a8a7-8b144701e082 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:03.215895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:03.221054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd49c3-9d38-4c4f-bb2b-2ee18c17a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:03.221707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd49c3-9d38-4c4f-bb2b-2ee18c17a61e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:03.222407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd49c3-9d38-4c4f-bb2b-2ee18c17a61e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:03.222694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd49c3-9d38-4c4f-bb2b-2ee18c17a61e None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:03.223872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd49c3-9d38-4c4f-bb2b-2ee18c17a61e None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:03.225851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd49c3-9d38-4c4f-bb2b-2ee18c17a61e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:03.228285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 198/388] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:03 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:03.234027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aea2ed-59f9-4d8a-8499-653a3f3086f7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:03.256606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd49c3-9d38-4c4f-bb2b-2ee18c17a61e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:03.414404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aea2ed-59f9-4d8a-8499-653a3f3086f7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:03.436700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd49c3-9d38-4c4f-bb2b-2ee18c17a61e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:03.470721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:03.481715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a8c38-e803-4a07-b01b-c349b7cabf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:03.482466 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a8c38-e803-4a07-b01b-c349b7cabf0e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:03.482755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a8c38-e803-4a07-b01b-c349b7cabf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:03.483033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a8c38-e803-4a07-b01b-c349b7cabf0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:03.489094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92f13a-d7b7-40be-883b-4afd33e1c680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:03.489779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92f13a-d7b7-40be-883b-4afd33e1c680 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:03.490061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92f13a-d7b7-40be-883b-4afd33e1c680 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:03.490606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92f13a-d7b7-40be-883b-4afd33e1c680 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/groups/30c80232afaa4c5b953d2dac4178778a/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:03.495952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92f13a-d7b7-40be-883b-4afd33e1c680 None admin] RBAC: Authorizing `identity:create_grant(project_id=15ee3b151eae4eaeb717f9ddd26bc41f, group_id=30c80232afaa4c5b953d2dac4178778a, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:03.497718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92f13a-d7b7-40be-883b-4afd33e1c680 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:03.506764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a8c38-e803-4a07-b01b-c349b7cabf0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-061a8c38-e803-4a07-b01b-c349b7cabf0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:03.512878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:03.513866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:51:03.514753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:03.526333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 191/390] 10.222.0.81 () {58 vars in 1442 bytes} [Thu Aug 18 16:51:03 2022] PUT /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/groups/30c80232afaa4c5b953d2dac4178778a/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:51:03.527171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92f13a-d7b7-40be-883b-4afd33e1c680 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:03.527508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 199/390] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:51:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:03.678563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92f13a-d7b7-40be-883b-4afd33e1c680 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:03.742842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa820e4-e88f-46c0-8a27-10d6cac193e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:03.742965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa820e4-e88f-46c0-8a27-10d6cac193e0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:03.743217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa820e4-e88f-46c0-8a27-10d6cac193e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:03.743494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa820e4-e88f-46c0-8a27-10d6cac193e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:03.744178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa820e4-e88f-46c0-8a27-10d6cac193e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:03.744505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa820e4-e88f-46c0-8a27-10d6cac193e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:03.745945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa820e4-e88f-46c0-8a27-10d6cac193e0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:03.756727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 192/391] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:03.762471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a8c38-e803-4a07-b01b-c349b7cabf0e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:03.835673 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177843f-b394-46ad-b39f-5e0f5de6f49a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:03.835991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177843f-b394-46ad-b39f-5e0f5de6f49a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:03.836234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177843f-b394-46ad-b39f-5e0f5de6f49a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:03.837837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 193/392] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:51:03.844391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635d57-1f9b-4730-92e6-cb2b122f2232 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:03.844722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635d57-1f9b-4730-92e6-cb2b122f2232 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:03.845517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635d57-1f9b-4730-92e6-cb2b122f2232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:03.868233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-63635d57-1f9b-4730-92e6-cb2b122f2232 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:03.869666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-63635d57-1f9b-4730-92e6-cb2b122f2232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:03.872863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:03.932884 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:03.957683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 194/393] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:51:03.979717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a8c38-e803-4a07-b01b-c349b7cabf0e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:04.032837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d788-9e46-4e15-9bee-c35e3338f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:04.033448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d788-9e46-4e15-9bee-c35e3338f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:04.033734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d788-9e46-4e15-9bee-c35e3338f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:04.034010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727d788-9e46-4e15-9bee-c35e3338f2a0 None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:04.035126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727d788-9e46-4e15-9bee-c35e3338f2a0 None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:04.036598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727d788-9e46-4e15-9bee-c35e3338f2a0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:04.038532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 200/394] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:03 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:04.044714 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63635d57-1f9b-4730-92e6-cb2b122f2232 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:04.185412 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63635d57-1f9b-4730-92e6-cb2b122f2232 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:04.221503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b29bc2-1fa3-47af-bb1b-c149c6fd0951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:04.222148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29bc2-1fa3-47af-bb1b-c149c6fd0951 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:04.222430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29bc2-1fa3-47af-bb1b-c149c6fd0951 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:04.222707 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b29bc2-1fa3-47af-bb1b-c149c6fd0951 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:04.223863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b29bc2-1fa3-47af-bb1b-c149c6fd0951 None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:04.225344 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b29bc2-1fa3-47af-bb1b-c149c6fd0951 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:04.227295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 195/395] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:04 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:04.233018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d788-9e46-4e15-9bee-c35e3338f2a0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:04.312630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b29bc2-1fa3-47af-bb1b-c149c6fd0951 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:04.407774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:04.430831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727d788-9e46-4e15-9bee-c35e3338f2a0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:04.496990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:04.516032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c639a-b757-457d-9e36-016bce373faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:04.518361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c639a-b757-457d-9e36-016bce373faa None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:04.518944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c639a-b757-457d-9e36-016bce373faa None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:04.519421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c639a-b757-457d-9e36-016bce373faa None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/groups/30c80232afaa4c5b953d2dac4178778a/roles/f196d84ade534597912f4ce3ca3f36ee` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:04.524422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b29bc2-1fa3-47af-bb1b-c149c6fd0951 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:04.528480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c639a-b757-457d-9e36-016bce373faa None admin] RBAC: Authorizing `identity:create_grant(project_id=15ee3b151eae4eaeb717f9ddd26bc41f, group_id=30c80232afaa4c5b953d2dac4178778a, role_id=f196d84ade534597912f4ce3ca3f36ee)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:04.531397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c639a-b757-457d-9e36-016bce373faa None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:04.560248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 201/396] 10.222.0.81 () {58 vars in 1442 bytes} [Thu Aug 18 16:51:04 2022] PUT /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f/groups/30c80232afaa4c5b953d2dac4178778a/roles/f196d84ade534597912f4ce3ca3f36ee => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:51:04.564270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55799aea-dcab-4bf4-90ed-43062a4a2d73 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:04.566281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55799aea-dcab-4bf4-90ed-43062a4a2d73 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:04.570377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55799aea-dcab-4bf4-90ed-43062a4a2d73 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:04.578295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 202/397] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:04 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:04.580675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db759b7-661e-4ec4-af8a-32a70c89a336 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:04.581454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db759b7-661e-4ec4-af8a-32a70c89a336 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:04.583483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db759b7-661e-4ec4-af8a-32a70c89a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:04.614665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6c4e9-56bc-459b-8bf3-070b7bf4ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:04.615970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6c4e9-56bc-459b-8bf3-070b7bf4ba29 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:04.616533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6c4e9-56bc-459b-8bf3-070b7bf4ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:04.617118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6c4e9-56bc-459b-8bf3-070b7bf4ba29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:04.624006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2db759b7-661e-4ec4-af8a-32a70c89a336 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:04.628507 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2db759b7-661e-4ec4-af8a-32a70c89a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:04.641842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6c4e9-56bc-459b-8bf3-070b7bf4ba29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9ef6c4e9-56bc-459b-8bf3-070b7bf4ba29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:04.648210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:04.649320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:51:04.650147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:04.650789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 196/398] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:04.661368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6c4e9-56bc-459b-8bf3-070b7bf4ba29 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:04.805463 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 203/399] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:51:04.887830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6c4e9-56bc-459b-8bf3-070b7bf4ba29 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:04.901836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:04.945303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682cad1-3360-4cf9-80c2-ae009cbde5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:04.945942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682cad1-3360-4cf9-80c2-ae009cbde5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:04.946222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682cad1-3360-4cf9-80c2-ae009cbde5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:04.946625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682cad1-3360-4cf9-80c2-ae009cbde5b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:04.947299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682cad1-3360-4cf9-80c2-ae009cbde5b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:04.947618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682cad1-3360-4cf9-80c2-ae009cbde5b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:04.949116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682cad1-3360-4cf9-80c2-ae009cbde5b6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:04.957498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53996e-3e85-4af0-87a0-7eae6d43e353 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:04.957842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53996e-3e85-4af0-87a0-7eae6d43e353 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:04.958064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53996e-3e85-4af0-87a0-7eae6d43e353 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:04.959694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 204/400] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:04.960896 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 197/401] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:51:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:04.968495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113e8c5-a7bb-4c90-b784-bd7d8bb6ee1e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:04.968495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113e8c5-a7bb-4c90-b784-bd7d8bb6ee1e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:04.968794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682cad1-3360-4cf9-80c2-ae009cbde5b6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:04.968878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113e8c5-a7bb-4c90-b784-bd7d8bb6ee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:05.007710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e113e8c5-a7bb-4c90-b784-bd7d8bb6ee1e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:05.009064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e113e8c5-a7bb-4c90-b784-bd7d8bb6ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:05.119382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682cad1-3360-4cf9-80c2-ae009cbde5b6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:05.139154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 205/402] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:05.160192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cf1ca-1c49-4087-add7-a56e4f31569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:05.161164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cf1ca-1c49-4087-add7-a56e4f31569b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:05.161610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cf1ca-1c49-4087-add7-a56e4f31569b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:05.162089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cf1ca-1c49-4087-add7-a56e4f31569b None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:05.163413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cf1ca-1c49-4087-add7-a56e4f31569b None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:05.165102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cf1ca-1c49-4087-add7-a56e4f31569b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:05.167238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 198/403] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:04 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:05.172629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113e8c5-a7bb-4c90-b784-bd7d8bb6ee1e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:05.184178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cf1ca-1c49-4087-add7-a56e4f31569b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:05.227924 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:05.253632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:05.319646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cf1ca-1c49-4087-add7-a56e4f31569b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:05.340729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113e8c5-a7bb-4c90-b784-bd7d8bb6ee1e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:05.379443 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc253468-4aae-4c20-88dd-913c6344b806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:05.380092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc253468-4aae-4c20-88dd-913c6344b806 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:05.380376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc253468-4aae-4c20-88dd-913c6344b806 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:05.380672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc253468-4aae-4c20-88dd-913c6344b806 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:05.398625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc253468-4aae-4c20-88dd-913c6344b806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fc253468-4aae-4c20-88dd-913c6344b806 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:05.406869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:05.408378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:51:05.409242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:05.409852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64ec6-1e63-47e9-8336-17a2065f0ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:05.409949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64ec6-1e63-47e9-8336-17a2065f0ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:05.410554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64ec6-1e63-47e9-8336-17a2065f0ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:05.410554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64ec6-1e63-47e9-8336-17a2065f0ac7 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:05.411266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 199/404] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:51:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:05.416505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc253468-4aae-4c20-88dd-913c6344b806 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:05.421764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f64ec6-1e63-47e9-8336-17a2065f0ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:05.422823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f64ec6-1e63-47e9-8336-17a2065f0ac7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:05.425537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 206/405] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:05 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:05.431350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64ec6-1e63-47e9-8336-17a2065f0ac7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:05.529163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc253468-4aae-4c20-88dd-913c6344b806 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:05.533347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:05.539945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64ec6-1e63-47e9-8336-17a2065f0ac7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:05.557509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:05.572216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2269f2-b7f0-4b47-8445-24847575fdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:05.573246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2269f2-b7f0-4b47-8445-24847575fdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:05.573822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2269f2-b7f0-4b47-8445-24847575fdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:05.574312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2269f2-b7f0-4b47-8445-24847575fdf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:05.575291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2269f2-b7f0-4b47-8445-24847575fdf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:05.575808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2269f2-b7f0-4b47-8445-24847575fdf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:05.577461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2269f2-b7f0-4b47-8445-24847575fdf6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:05.581113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6341-294c-48f5-abf1-e854b652cea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:05.581811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6341-294c-48f5-abf1-e854b652cea2 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:05.582096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6341-294c-48f5-abf1-e854b652cea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:05.582373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6341-294c-48f5-abf1-e854b652cea2 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572/groups/30c80232afaa4c5b953d2dac4178778a/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:05.584579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d6341-294c-48f5-abf1-e854b652cea2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b872016c0ae541aab80d335607224572, group_id=30c80232afaa4c5b953d2dac4178778a, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:05.586236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d6341-294c-48f5-abf1-e854b652cea2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:05.594669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 200/406] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:05.594669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2269f2-b7f0-4b47-8445-24847575fdf6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:05.606481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 207/407] 10.222.0.81 () {58 vars in 1442 bytes} [Thu Aug 18 16:51:05 2022] PUT /identity/v3/projects/b872016c0ae541aab80d335607224572/groups/30c80232afaa4c5b953d2dac4178778a/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:51:05.607359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6341-294c-48f5-abf1-e854b652cea2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:05.744803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6341-294c-48f5-abf1-e854b652cea2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:05.789138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6a0fb-081d-4856-bf32-da7c4e33cf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:05.790341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6a0fb-081d-4856-bf32-da7c4e33cf3b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:05.790835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6a0fb-081d-4856-bf32-da7c4e33cf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:05.791407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6a0fb-081d-4856-bf32-da7c4e33cf3b None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:05.793028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6a0fb-081d-4856-bf32-da7c4e33cf3b None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:05.795433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6a0fb-081d-4856-bf32-da7c4e33cf3b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:05.798604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 208/408] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:05 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:05.805706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6a0fb-081d-4856-bf32-da7c4e33cf3b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:05.855208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2269f2-b7f0-4b47-8445-24847575fdf6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:05.871738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:05.898720 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51986c-f50d-4bde-8569-f3cfd62b8f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:05.899737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51986c-f50d-4bde-8569-f3cfd62b8f4c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:05.900236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51986c-f50d-4bde-8569-f3cfd62b8f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:05.900778 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51986c-f50d-4bde-8569-f3cfd62b8f4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:05.915025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51986c-f50d-4bde-8569-f3cfd62b8f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4c51986c-f50d-4bde-8569-f3cfd62b8f4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:05.920885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:05.921832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:05.922674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:05.925939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 201/409] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:05.931771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51986c-f50d-4bde-8569-f3cfd62b8f4c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:05.961410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:05.963122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6a0fb-081d-4856-bf32-da7c4e33cf3b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:06.014286 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6954889-90b6-4f88-ab76-af104b04a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:06.014625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6954889-90b6-4f88-ab76-af104b04a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:06.014841 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6954889-90b6-4f88-ab76-af104b04a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:06.015113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6954889-90b6-4f88-ab76-af104b04a7f3 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:06.017257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6954889-90b6-4f88-ab76-af104b04a7f3 None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:06.020025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6954889-90b6-4f88-ab76-af104b04a7f3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:06.023016 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 209/410] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:05 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:06.025506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0d2dc-5771-4558-8521-a83e837ec52d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:06.025830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0d2dc-5771-4558-8521-a83e837ec52d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:06.026092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0d2dc-5771-4558-8521-a83e837ec52d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:06.029249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 210/411] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:06.030360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0d2dc-5771-4558-8521-a83e837ec52d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:06.072270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51986c-f50d-4bde-8569-f3cfd62b8f4c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:06.121148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847941ad-9ae7-4f09-b585-93650674a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:06.122356 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847941ad-9ae7-4f09-b585-93650674a93f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:06.123453 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847941ad-9ae7-4f09-b585-93650674a93f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:06.123893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847941ad-9ae7-4f09-b585-93650674a93f None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:06.125057 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847941ad-9ae7-4f09-b585-93650674a93f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:06.125513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847941ad-9ae7-4f09-b585-93650674a93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:06.128686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847941ad-9ae7-4f09-b585-93650674a93f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:06.146578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 202/412] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:06.148071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd6bd3-807b-43f1-a0e1-d7696ef43dce None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:06.148363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd6bd3-807b-43f1-a0e1-d7696ef43dce None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:06.148681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd6bd3-807b-43f1-a0e1-d7696ef43dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:06.164081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0d2dc-5771-4558-8521-a83e837ec52d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:06.168503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f6fd6bd3-807b-43f1-a0e1-d7696ef43dce None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:06.170016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f6fd6bd3-807b-43f1-a0e1-d7696ef43dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:06.179128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:06.203307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974ecb-a7df-4998-9fa2-f464515c3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:06.204420 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974ecb-a7df-4998-9fa2-f464515c3f04 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:06.205073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974ecb-a7df-4998-9fa2-f464515c3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:06.205645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18974ecb-a7df-4998-9fa2-f464515c3f04 None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572/groups/30c80232afaa4c5b953d2dac4178778a/roles/f196d84ade534597912f4ce3ca3f36ee` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:06.208198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18974ecb-a7df-4998-9fa2-f464515c3f04 None admin] RBAC: Authorizing `identity:create_grant(project_id=b872016c0ae541aab80d335607224572, group_id=30c80232afaa4c5b953d2dac4178778a, role_id=f196d84ade534597912f4ce3ca3f36ee)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:06.209918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18974ecb-a7df-4998-9fa2-f464515c3f04 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:06.226926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 211/413] 10.222.0.81 () {58 vars in 1442 bytes} [Thu Aug 18 16:51:06 2022] PUT /identity/v3/projects/b872016c0ae541aab80d335607224572/groups/30c80232afaa4c5b953d2dac4178778a/roles/f196d84ade534597912f4ce3ca3f36ee => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:51:06.228313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974ecb-a7df-4998-9fa2-f464515c3f04 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:06.256488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 203/414] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:06.376159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18974ecb-a7df-4998-9fa2-f464515c3f04 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:06.420971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682af62-e388-4a7b-935f-60745544442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:06.421807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682af62-e388-4a7b-935f-60745544442a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:06.422207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682af62-e388-4a7b-935f-60745544442a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:06.422536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682af62-e388-4a7b-935f-60745544442a None admin] PATH_INFO: `/v3/groups/30a427c8a6fe4bbd95a0228d4de442f1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:06.425022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682af62-e388-4a7b-935f-60745544442a None admin] RBAC: Authorizing `identity:get_group(group_id=30a427c8a6fe4bbd95a0228d4de442f1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:06.427918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682af62-e388-4a7b-935f-60745544442a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:06.429962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 212/415] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:06 2022] GET /identity/v3/groups/30a427c8a6fe4bbd95a0228d4de442f1 => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:06.438339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd6bd3-807b-43f1-a0e1-d7696ef43dce None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:06.470983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:06.575216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd6bd3-807b-43f1-a0e1-d7696ef43dce None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:06.582916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682af62-e388-4a7b-935f-60745544442a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:06.623029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5d3f1-da23-46a1-ad0a-c1124ab65c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:06.623690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5d3f1-da23-46a1-ad0a-c1124ab65c8d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:06.623974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5d3f1-da23-46a1-ad0a-c1124ab65c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:06.624251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5d3f1-da23-46a1-ad0a-c1124ab65c8d None admin] PATH_INFO: `/v3/projects/45c851fba36042bc85eb05b39752f169` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:06.627018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5d3f1-da23-46a1-ad0a-c1124ab65c8d None admin] RBAC: Authorizing `identity:get_project(project_id=45c851fba36042bc85eb05b39752f169)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:06.628404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5d3f1-da23-46a1-ad0a-c1124ab65c8d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:06.630283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 204/416] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:06 2022] GET /identity/v3/projects/45c851fba36042bc85eb05b39752f169 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:06.637795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5d3f1-da23-46a1-ad0a-c1124ab65c8d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:06.667358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:06.767517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:06.804282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682af62-e388-4a7b-935f-60745544442a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:06.808104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5d3f1-da23-46a1-ad0a-c1124ab65c8d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:06.852201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f3d0a-d54f-4431-9574-3604e19b17c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:06.852912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f3d0a-d54f-4431-9574-3604e19b17c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:06.853195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f3d0a-d54f-4431-9574-3604e19b17c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:06.853477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f3d0a-d54f-4431-9574-3604e19b17c0 None admin] PATH_INFO: `/v3/projects/45c851fba36042bc85eb05b39752f169/groups/30a427c8a6fe4bbd95a0228d4de442f1/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:06.855409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f3d0a-d54f-4431-9574-3604e19b17c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=45c851fba36042bc85eb05b39752f169, group_id=30a427c8a6fe4bbd95a0228d4de442f1, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:06.857048 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f3d0a-d54f-4431-9574-3604e19b17c0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:06.878859 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 205/417] 10.222.0.81 () {58 vars in 1442 bytes} [Thu Aug 18 16:51:06 2022] PUT /identity/v3/projects/45c851fba36042bc85eb05b39752f169/groups/30a427c8a6fe4bbd95a0228d4de442f1/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:51:06.889803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a73e26-bfed-41f5-bb0e-6463777275db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:06.890467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a73e26-bfed-41f5-bb0e-6463777275db None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:06.890755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a73e26-bfed-41f5-bb0e-6463777275db None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:06.891028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a73e26-bfed-41f5-bb0e-6463777275db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:06.910613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a73e26-bfed-41f5-bb0e-6463777275db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e2a73e26-bfed-41f5-bb0e-6463777275db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:06.918136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:06.919087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:06.919905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 213/418] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:06.925650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f3d0a-d54f-4431-9574-3604e19b17c0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:07.010678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d90f8-9fdb-48d8-9fd1-173adb2eb27c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:07.011030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d90f8-9fdb-48d8-9fd1-173adb2eb27c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:07.011293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d90f8-9fdb-48d8-9fd1-173adb2eb27c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:07.012737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 214/419] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:51:07.020012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5cd1-4b2b-4603-82e4-600af5b91a2d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:07.020668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5cd1-4b2b-4603-82e4-600af5b91a2d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:07.021150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5cd1-4b2b-4603-82e4-600af5b91a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:07.057350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-68eb5cd1-4b2b-4603-82e4-600af5b91a2d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:07.058908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-68eb5cd1-4b2b-4603-82e4-600af5b91a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:07.098179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f3d0a-d54f-4431-9574-3604e19b17c0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:07.149689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995bcd-c85d-41fd-ae67-bc92317afd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:07.150707 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995bcd-c85d-41fd-ae67-bc92317afd4f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:07.152009 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995bcd-c85d-41fd-ae67-bc92317afd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:07.152672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995bcd-c85d-41fd-ae67-bc92317afd4f None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:07.153618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41995bcd-c85d-41fd-ae67-bc92317afd4f None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:07.154792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41995bcd-c85d-41fd-ae67-bc92317afd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:07.157130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41995bcd-c85d-41fd-ae67-bc92317afd4f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:07.170634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 206/420] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:51:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:07.176178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995bcd-c85d-41fd-ae67-bc92317afd4f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:07.180056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:07.191120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 215/421] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:07.303387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995bcd-c85d-41fd-ae67-bc92317afd4f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:07.346960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d324a5-8616-4ce4-b2be-502df348e7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:07.347591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d324a5-8616-4ce4-b2be-502df348e7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:07.347877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d324a5-8616-4ce4-b2be-502df348e7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:07.348157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d324a5-8616-4ce4-b2be-502df348e7e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:07.450563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d324a5-8616-4ce4-b2be-502df348e7e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:07.452031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d324a5-8616-4ce4-b2be-502df348e7e7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:07.453970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:07.461617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb5cd1-4b2b-4603-82e4-600af5b91a2d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:07.498683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:07.574586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb5cd1-4b2b-4603-82e4-600af5b91a2d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:07.612224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418182a6-6fcf-49e4-b5e0-fbc80cd4f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:07.613267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418182a6-6fcf-49e4-b5e0-fbc80cd4f9cf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:07.613761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418182a6-6fcf-49e4-b5e0-fbc80cd4f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:07.614249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418182a6-6fcf-49e4-b5e0-fbc80cd4f9cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:07.625457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418182a6-6fcf-49e4-b5e0-fbc80cd4f9cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-418182a6-6fcf-49e4-b5e0-fbc80cd4f9cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:07.631070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:07.631976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:51:07.632823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:07.635108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 216/422] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:51:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:07.640893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418182a6-6fcf-49e4-b5e0-fbc80cd4f9cf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:07.696496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 207/423] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:51:07.703269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d324a5-8616-4ce4-b2be-502df348e7e7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:07.780749 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:07.791880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418182a6-6fcf-49e4-b5e0-fbc80cd4f9cf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:07.830759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d1b6-f588-46bd-b84c-7505d755a483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:07.831492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d1b6-f588-46bd-b84c-7505d755a483 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:07.831873 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d1b6-f588-46bd-b84c-7505d755a483 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:07.832247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d1b6-f588-46bd-b84c-7505d755a483 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:07.833042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d1b6-f588-46bd-b84c-7505d755a483 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:07.833445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d1b6-f588-46bd-b84c-7505d755a483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:07.833692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d324a5-8616-4ce4-b2be-502df348e7e7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:07.835019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d1b6-f588-46bd-b84c-7505d755a483 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:07.835641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:07.844901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 217/424] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:07.850393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d1b6-f588-46bd-b84c-7505d755a483 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:07.871411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71406f12-3de4-4b8f-9af3-8ef408de0f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:07.872386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71406f12-3de4-4b8f-9af3-8ef408de0f1f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:07.873140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71406f12-3de4-4b8f-9af3-8ef408de0f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:07.873561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71406f12-3de4-4b8f-9af3-8ef408de0f1f None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:07.874841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71406f12-3de4-4b8f-9af3-8ef408de0f1f None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:07.876529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71406f12-3de4-4b8f-9af3-8ef408de0f1f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:07.878689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 208/425] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:07 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:07.888486 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71406f12-3de4-4b8f-9af3-8ef408de0f1f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:08.021357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d1b6-f588-46bd-b84c-7505d755a483 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:08.079000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71406f12-3de4-4b8f-9af3-8ef408de0f1f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:08.094330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e6a1e-840e-46a5-99f4-d037d601686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:08.095495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e6a1e-840e-46a5-99f4-d037d601686b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:08.095783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e6a1e-840e-46a5-99f4-d037d601686b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:08.096065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e6a1e-840e-46a5-99f4-d037d601686b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:08.134835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:08.160776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd422-e27c-471a-9da4-73bfe5833872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:08.161477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd422-e27c-471a-9da4-73bfe5833872 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:08.161709 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd422-e27c-471a-9da4-73bfe5833872 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:08.161985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd422-e27c-471a-9da4-73bfe5833872 None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:08.163115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bd422-e27c-471a-9da4-73bfe5833872 None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:08.164588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bd422-e27c-471a-9da4-73bfe5833872 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:08.173594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 209/426] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:07 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:08.179278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd422-e27c-471a-9da4-73bfe5833872 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:08.206184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e6a1e-840e-46a5-99f4-d037d601686b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:08.209354 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e6a1e-840e-46a5-99f4-d037d601686b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:08.249234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:08.334699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd422-e27c-471a-9da4-73bfe5833872 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:08.352548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 218/427] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:51:08.354117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7413c-f43b-490a-afd1-a483bcd05f34 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:08.354550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7413c-f43b-490a-afd1-a483bcd05f34 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:08.354973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7413c-f43b-490a-afd1-a483bcd05f34 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:08.357535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 219/428] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:08.359195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7413c-f43b-490a-afd1-a483bcd05f34 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:08.384028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d2dd7-4292-46a4-a37c-696f0ebd6de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:08.384840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d2dd7-4292-46a4-a37c-696f0ebd6de4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:08.385375 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d2dd7-4292-46a4-a37c-696f0ebd6de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:08.385954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d2dd7-4292-46a4-a37c-696f0ebd6de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:08.386904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d2dd7-4292-46a4-a37c-696f0ebd6de4 None admin] RBAC: Adding query filter params (group.id=30c80232afaa4c5b953d2dac4178778a, role.id=6bf2c10dc09a4e9087fd12312566376f, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:08.387454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d2dd7-4292-46a4-a37c-696f0ebd6de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:08.389331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d2dd7-4292-46a4-a37c-696f0ebd6de4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:08.396833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 210/429] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Aug 18 16:51:08 2022] GET /identity/v3/role_assignments?group.id=30c80232afaa4c5b953d2dac4178778a&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:08.398691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cd065-4c57-4bc2-8520-0944f1bdb115 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:08.399280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cd065-4c57-4bc2-8520-0944f1bdb115 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:08.399759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cd065-4c57-4bc2-8520-0944f1bdb115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:08.420021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6a4cd065-4c57-4bc2-8520-0944f1bdb115 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:08.421680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6a4cd065-4c57-4bc2-8520-0944f1bdb115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:08.422613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:08.481885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7413c-f43b-490a-afd1-a483bcd05f34 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:08.504278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 211/430] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:08.521993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded3280-0233-47d9-98a4-c7c8bd31dea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:08.522636 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded3280-0233-47d9-98a4-c7c8bd31dea5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:08.522920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded3280-0233-47d9-98a4-c7c8bd31dea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:08.523194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded3280-0233-47d9-98a4-c7c8bd31dea5 None admin] PATH_INFO: `/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:08.524398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded3280-0233-47d9-98a4-c7c8bd31dea5 None admin] RBAC: Authorizing `identity:get_project(project_id=15ee3b151eae4eaeb717f9ddd26bc41f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:08.525931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded3280-0233-47d9-98a4-c7c8bd31dea5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:08.527941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 220/431] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:08 2022] GET /identity/v3/projects/15ee3b151eae4eaeb717f9ddd26bc41f => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:08.533411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cd065-4c57-4bc2-8520-0944f1bdb115 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:08.589217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:08.630171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7c2c-7360-482a-849c-c03145905606 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:08.630607 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7c2c-7360-482a-849c-c03145905606 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:08.631092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc7c2c-7360-482a-849c-c03145905606 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:08.632995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 221/432] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:51:08.639101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb521-4890-4e8c-91c1-5f8ff56e7676 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:08.639697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb521-4890-4e8c-91c1-5f8ff56e7676 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:08.640021 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfb521-4890-4e8c-91c1-5f8ff56e7676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:08.662729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1abfb521-4890-4e8c-91c1-5f8ff56e7676 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:08.664097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1abfb521-4890-4e8c-91c1-5f8ff56e7676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:08.665419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cd065-4c57-4bc2-8520-0944f1bdb115 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:08.702351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b333-3f54-4371-86fe-84c26f361f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:08.703331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b333-3f54-4371-86fe-84c26f361f45 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:08.703793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b333-3f54-4371-86fe-84c26f361f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:08.704782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b333-3f54-4371-86fe-84c26f361f45 None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:08.706290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034b333-3f54-4371-86fe-84c26f361f45 None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:08.707897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034b333-3f54-4371-86fe-84c26f361f45 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:08.710019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 212/433] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:08 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:08.715878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b333-3f54-4371-86fe-84c26f361f45 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:08.742589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 222/434] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:51:08.819723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:08.825994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b333-3f54-4371-86fe-84c26f361f45 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:08.853236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfb521-4890-4e8c-91c1-5f8ff56e7676 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:08.864435 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2022f-259b-468c-9ac9-9d0f811043a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:08.865640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2022f-259b-468c-9ac9-9d0f811043a9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:08.866158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2022f-259b-468c-9ac9-9d0f811043a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:08.866604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2022f-259b-468c-9ac9-9d0f811043a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:08.867511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2022f-259b-468c-9ac9-9d0f811043a9 None admin] RBAC: Adding query filter params (group.id=30c80232afaa4c5b953d2dac4178778a, role.id=f196d84ade534597912f4ce3ca3f36ee, scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:08.868013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2022f-259b-468c-9ac9-9d0f811043a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:08.869959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2022f-259b-468c-9ac9-9d0f811043a9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:08.877561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 213/435] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Aug 18 16:51:08 2022] GET /identity/v3/role_assignments?group.id=30c80232afaa4c5b953d2dac4178778a&scope.project.id=15ee3b151eae4eaeb717f9ddd26bc41f&role.id=f196d84ade534597912f4ce3ca3f36ee => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:08.916408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:08.978646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfb521-4890-4e8c-91c1-5f8ff56e7676 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:09.024279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29187b-1d6a-4f7c-8806-362757d4f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:09.024956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29187b-1d6a-4f7c-8806-362757d4f5ed None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:09.025234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29187b-1d6a-4f7c-8806-362757d4f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:09.025510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29187b-1d6a-4f7c-8806-362757d4f5ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:09.037403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29187b-1d6a-4f7c-8806-362757d4f5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-cc29187b-1d6a-4f7c-8806-362757d4f5ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:09.042141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:09.043027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 16:51:09.043851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:09.048049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 223/436] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:09.049580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2022f-259b-468c-9ac9-9d0f811043a9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:09.088498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29187b-1d6a-4f7c-8806-362757d4f5ed None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:09.179359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2022f-259b-468c-9ac9-9d0f811043a9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:09.221654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0c6d-93b0-4179-b29a-27bcf04aafce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:09.222518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0c6d-93b0-4179-b29a-27bcf04aafce None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:09.222943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0c6d-93b0-4179-b29a-27bcf04aafce None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:09.223358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0c6d-93b0-4179-b29a-27bcf04aafce None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:09.224203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0c6d-93b0-4179-b29a-27bcf04aafce None admin] RBAC: Adding query filter params (name=member) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:09.224672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0c6d-93b0-4179-b29a-27bcf04aafce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:09.226187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29187b-1d6a-4f7c-8806-362757d4f5ed None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:09.226320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0c6d-93b0-4179-b29a-27bcf04aafce None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:09.238379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 214/437] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:09.242923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:09.246636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0c6d-93b0-4179-b29a-27bcf04aafce None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:09.279512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895085b-1947-4986-99c1-9567d3066f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:09.280231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895085b-1947-4986-99c1-9567d3066f2d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:09.280436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895085b-1947-4986-99c1-9567d3066f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:09.280741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895085b-1947-4986-99c1-9567d3066f2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:09.290173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:09.300293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895085b-1947-4986-99c1-9567d3066f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f895085b-1947-4986-99c1-9567d3066f2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:09.305356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:09.306353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:51:09.307298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:09.309337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 224/438] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:51:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:09.316983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895085b-1947-4986-99c1-9567d3066f2d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:09.420831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0c6d-93b0-4179-b29a-27bcf04aafce None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:09.469341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a29ff9-4ccd-464c-b13f-5513a84ae33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:09.470499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a29ff9-4ccd-464c-b13f-5513a84ae33c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:09.470940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a29ff9-4ccd-464c-b13f-5513a84ae33c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:09.471596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a29ff9-4ccd-464c-b13f-5513a84ae33c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:09.471719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895085b-1947-4986-99c1-9567d3066f2d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:09.512654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8299a76-ae39-44c9-be73-f3cd5ded19ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:09.513286 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8299a76-ae39-44c9-be73-f3cd5ded19ce None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:09.513537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8299a76-ae39-44c9-be73-f3cd5ded19ce None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:09.514009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8299a76-ae39-44c9-be73-f3cd5ded19ce None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:09.514850 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8299a76-ae39-44c9-be73-f3cd5ded19ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:09.515159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8299a76-ae39-44c9-be73-f3cd5ded19ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:09.517178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8299a76-ae39-44c9-be73-f3cd5ded19ce None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:09.526038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 225/439] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:09.527255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace84f3-f98b-44cc-b5c3-eee29dff20a9 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:09.527532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace84f3-f98b-44cc-b5c3-eee29dff20a9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:09.527812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace84f3-f98b-44cc-b5c3-eee29dff20a9 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:09.532861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 226/440] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:09.532861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace84f3-f98b-44cc-b5c3-eee29dff20a9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:09.553551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a29ff9-4ccd-464c-b13f-5513a84ae33c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:09.555026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a29ff9-4ccd-464c-b13f-5513a84ae33c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:09.567023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:09.583263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:09.638936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace84f3-f98b-44cc-b5c3-eee29dff20a9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:09.657611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 215/441] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:51:09.658869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abaacb-9f40-426c-87c0-9857ad861306 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:09.659153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abaacb-9f40-426c-87c0-9857ad861306 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:09.659427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abaacb-9f40-426c-87c0-9857ad861306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:09.676431 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-72abaacb-9f40-426c-87c0-9857ad861306 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:09.676620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b04e-c8af-499f-8b64-47a618024d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:09.677671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-72abaacb-9f40-426c-87c0-9857ad861306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:09.677787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b04e-c8af-499f-8b64-47a618024d31 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:09.678002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b04e-c8af-499f-8b64-47a618024d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:09.678282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b04e-c8af-499f-8b64-47a618024d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:09.748640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b04e-c8af-499f-8b64-47a618024d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:09.750116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b04e-c8af-499f-8b64-47a618024d31 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:09.755362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 216/442] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:09.755362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abaacb-9f40-426c-87c0-9857ad861306 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:09.788073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:09.814750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:09.869150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 227/443] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:51:09.869384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abaacb-9f40-426c-87c0-9857ad861306 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:09.870231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b04e-c8af-499f-8b64-47a618024d31 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:09.905798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d0496-fcfb-4712-8204-04432b4930fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:09.906437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d0496-fcfb-4712-8204-04432b4930fa None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:09.906723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d0496-fcfb-4712-8204-04432b4930fa None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:09.907001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d0496-fcfb-4712-8204-04432b4930fa None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:09.908694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d0496-fcfb-4712-8204-04432b4930fa None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:09.910144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d0496-fcfb-4712-8204-04432b4930fa None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:09.911798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 217/444] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:09 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:09.918588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d0496-fcfb-4712-8204-04432b4930fa None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:09.978567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b04e-c8af-499f-8b64-47a618024d31 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:10.012869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:10.019111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d6f22-6d41-47d7-a7cc-2ea729f2cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:10.019683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6f22-6d41-47d7-a7cc-2ea729f2cabb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:10.019939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6f22-6d41-47d7-a7cc-2ea729f2cabb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:10.020328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6f22-6d41-47d7-a7cc-2ea729f2cabb None admin] PATH_INFO: `/v3/projects/b872016c0ae541aab80d335607224572` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:10.021681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d6f22-6d41-47d7-a7cc-2ea729f2cabb None admin] RBAC: Authorizing `identity:get_project(project_id=b872016c0ae541aab80d335607224572)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:10.023121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d6f22-6d41-47d7-a7cc-2ea729f2cabb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:10.029358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 228/445] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:09 2022] GET /identity/v3/projects/b872016c0ae541aab80d335607224572 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:10.029358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d6f22-6d41-47d7-a7cc-2ea729f2cabb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:10.029583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d0496-fcfb-4712-8204-04432b4930fa None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:10.052022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:10.066667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab06d3-8e89-4f32-9ced-6351e26794a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:10.067737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab06d3-8e89-4f32-9ced-6351e26794a1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:10.068223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab06d3-8e89-4f32-9ced-6351e26794a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:10.068749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab06d3-8e89-4f32-9ced-6351e26794a1 None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:10.070724 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab06d3-8e89-4f32-9ced-6351e26794a1 None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:10.073500 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab06d3-8e89-4f32-9ced-6351e26794a1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:10.081291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 218/446] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:09 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:10.081291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab06d3-8e89-4f32-9ced-6351e26794a1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:10.134927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d6f22-6d41-47d7-a7cc-2ea729f2cabb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:10.168902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6003517-2bfd-4771-82f7-4da60e2474e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:10.169534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6003517-2bfd-4771-82f7-4da60e2474e9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:10.169815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6003517-2bfd-4771-82f7-4da60e2474e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:10.170087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6003517-2bfd-4771-82f7-4da60e2474e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:10.176889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab06d3-8e89-4f32-9ced-6351e26794a1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:10.180827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6003517-2bfd-4771-82f7-4da60e2474e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b6003517-2bfd-4771-82f7-4da60e2474e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:10.186131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:10.187205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 229/447] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:10.188023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6003517-2bfd-4771-82f7-4da60e2474e9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:10.212876 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b886f82-3244-4fc0-95bf-cdb203e02824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:10.213511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886f82-3244-4fc0-95bf-cdb203e02824 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:10.213797 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886f82-3244-4fc0-95bf-cdb203e02824 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:10.214070 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886f82-3244-4fc0-95bf-cdb203e02824 None admin] PATH_INFO: `/v3/groups/30c80232afaa4c5b953d2dac4178778a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:10.215185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b886f82-3244-4fc0-95bf-cdb203e02824 None admin] RBAC: Authorizing `identity:get_group(group_id=30c80232afaa4c5b953d2dac4178778a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:10.216650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b886f82-3244-4fc0-95bf-cdb203e02824 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:10.218257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 219/448] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:10 2022] GET /identity/v3/groups/30c80232afaa4c5b953d2dac4178778a => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:10.218257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b886f82-3244-4fc0-95bf-cdb203e02824 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:10.248136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:10.284869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:10.290202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6003517-2bfd-4771-82f7-4da60e2474e9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:10.324783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d8a6-4627-488f-af9e-1e1209e86ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:10.325478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d8a6-4627-488f-af9e-1e1209e86ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:10.325758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d8a6-4627-488f-af9e-1e1209e86ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:10.326034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d8a6-4627-488f-af9e-1e1209e86ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:10.326757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81d8a6-4627-488f-af9e-1e1209e86ed6 None admin] RBAC: Adding query filter params (group.id=30c80232afaa4c5b953d2dac4178778a, role.id=6bf2c10dc09a4e9087fd12312566376f, scope.project.id=b872016c0ae541aab80d335607224572) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:10.326894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b886f82-3244-4fc0-95bf-cdb203e02824 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:10.327068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81d8a6-4627-488f-af9e-1e1209e86ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:10.328538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81d8a6-4627-488f-af9e-1e1209e86ed6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:10.334695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 230/449] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Aug 18 16:51:10 2022] GET /identity/v3/role_assignments?group.id=30c80232afaa4c5b953d2dac4178778a&scope.project.id=b872016c0ae541aab80d335607224572&role.id=6bf2c10dc09a4e9087fd12312566376f => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:10.335471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d8a6-4627-488f-af9e-1e1209e86ed6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:10.363020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a81159-5727-406e-8441-e1407b1fc95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:10.363622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a81159-5727-406e-8441-e1407b1fc95c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:10.363911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a81159-5727-406e-8441-e1407b1fc95c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:10.364187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a81159-5727-406e-8441-e1407b1fc95c None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:10.364911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a81159-5727-406e-8441-e1407b1fc95c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:10.365490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a81159-5727-406e-8441-e1407b1fc95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:10.366904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a81159-5727-406e-8441-e1407b1fc95c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:10.381629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 220/450] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:10.382953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a81159-5727-406e-8441-e1407b1fc95c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:10.476287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d8a6-4627-488f-af9e-1e1209e86ed6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:10.513748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:10.521705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a81159-5727-406e-8441-e1407b1fc95c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:10.528279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77625978-c846-4d41-acb0-f0b7ddf1f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:10.529263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77625978-c846-4d41-acb0-f0b7ddf1f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:10.529611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77625978-c846-4d41-acb0-f0b7ddf1f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:10.529951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77625978-c846-4d41-acb0-f0b7ddf1f3c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:10.530943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77625978-c846-4d41-acb0-f0b7ddf1f3c7 None admin] RBAC: Adding query filter params (group.id=30c80232afaa4c5b953d2dac4178778a, role.id=f196d84ade534597912f4ce3ca3f36ee, scope.project.id=b872016c0ae541aab80d335607224572) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:10.531265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77625978-c846-4d41-acb0-f0b7ddf1f3c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:10.532871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77625978-c846-4d41-acb0-f0b7ddf1f3c7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:10.540383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 231/451] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Aug 18 16:51:10 2022] GET /identity/v3/role_assignments?group.id=30c80232afaa4c5b953d2dac4178778a&scope.project.id=b872016c0ae541aab80d335607224572&role.id=f196d84ade534597912f4ce3ca3f36ee => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:10.551997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:10.569599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e9951-e07c-43bb-8439-5296e464cb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:10.570248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e9951-e07c-43bb-8439-5296e464cb3a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:10.570536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e9951-e07c-43bb-8439-5296e464cb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:10.570819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e9951-e07c-43bb-8439-5296e464cb3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:10.664933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e9951-e07c-43bb-8439-5296e464cb3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:10.666435 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e9951-e07c-43bb-8439-5296e464cb3a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:10.781245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 221/452] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 16:51:10.787351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77625978-c846-4d41-acb0-f0b7ddf1f3c7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:10.889137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77625978-c846-4d41-acb0-f0b7ddf1f3c7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:10.925730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa28afe-c047-4905-bbbf-3203edaf1b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:10.926385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa28afe-c047-4905-bbbf-3203edaf1b99 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:10.926654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa28afe-c047-4905-bbbf-3203edaf1b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:10.927061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa28afe-c047-4905-bbbf-3203edaf1b99 None admin] PATH_INFO: `/v3/projects/45c851fba36042bc85eb05b39752f169` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:10.928551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa28afe-c047-4905-bbbf-3203edaf1b99 None admin] RBAC: Authorizing `identity:get_project(project_id=45c851fba36042bc85eb05b39752f169)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:10.929981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa28afe-c047-4905-bbbf-3203edaf1b99 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:10.931598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 232/453] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:51:10 2022] GET /identity/v3/projects/45c851fba36042bc85eb05b39752f169 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:10.937305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e9951-e07c-43bb-8439-5296e464cb3a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:10.960758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:11.033101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e9951-e07c-43bb-8439-5296e464cb3a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:11.066559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afd513-2bb5-420f-b9b7-4eb75fe1d257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:11.067191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afd513-2bb5-420f-b9b7-4eb75fe1d257 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:11.067470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afd513-2bb5-420f-b9b7-4eb75fe1d257 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:11.067739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afd513-2bb5-420f-b9b7-4eb75fe1d257 None admin] PATH_INFO: `/v3/groups/30a427c8a6fe4bbd95a0228d4de442f1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:11.068854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afd513-2bb5-420f-b9b7-4eb75fe1d257 None admin] RBAC: Authorizing `identity:get_group(group_id=30a427c8a6fe4bbd95a0228d4de442f1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:11.070298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afd513-2bb5-420f-b9b7-4eb75fe1d257 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:11.071856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 222/454] 10.222.0.81 () {56 vars in 1180 bytes} [Thu Aug 18 16:51:10 2022] GET /identity/v3/groups/30a427c8a6fe4bbd95a0228d4de442f1 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:11.077871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa28afe-c047-4905-bbbf-3203edaf1b99 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:11.133540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:11.176537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa28afe-c047-4905-bbbf-3203edaf1b99 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:11.207613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721caaa-c9e6-4488-9c09-0cd1e658324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:11.208206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721caaa-c9e6-4488-9c09-0cd1e658324a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:11.208504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721caaa-c9e6-4488-9c09-0cd1e658324a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:11.208780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721caaa-c9e6-4488-9c09-0cd1e658324a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:11.209495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721caaa-c9e6-4488-9c09-0cd1e658324a None admin] RBAC: Adding query filter params (group.id=30a427c8a6fe4bbd95a0228d4de442f1, role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=45c851fba36042bc85eb05b39752f169) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:11.209809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721caaa-c9e6-4488-9c09-0cd1e658324a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:11.211219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721caaa-c9e6-4488-9c09-0cd1e658324a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:11.216777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 233/455] 10.222.0.81 () {56 vars in 1376 bytes} [Thu Aug 18 16:51:11 2022] GET /identity/v3/role_assignments?group.id=30a427c8a6fe4bbd95a0228d4de442f1&scope.project.id=45c851fba36042bc85eb05b39752f169&role.id=56228137a4444ef9b7e688d04abd00fd => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:13.531248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8bdd7-40d9-4fa4-8b6a-fe277d397460 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:13.532281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8bdd7-40d9-4fa4-8b6a-fe277d397460 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:13.532794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8bdd7-40d9-4fa4-8b6a-fe277d397460 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:13.535236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 223/456] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:13.541375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18677ba-380d-48af-b78d-a1ea1cbfd03a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:13.542325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18677ba-380d-48af-b78d-a1ea1cbfd03a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:13.542830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18677ba-380d-48af-b78d-a1ea1cbfd03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:13.566070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a18677ba-380d-48af-b78d-a1ea1cbfd03a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:13.567699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a18677ba-380d-48af-b78d-a1ea1cbfd03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:13.675825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 234/457] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:13.834963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606977a-33f0-4262-8f99-ebb28e3ea76e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:13.835564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606977a-33f0-4262-8f99-ebb28e3ea76e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:13.836041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606977a-33f0-4262-8f99-ebb28e3ea76e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:13.837903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 224/458] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:13.844060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201daa7-e3d5-4bc7-8cba-c5d82919abb1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:13.844683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201daa7-e3d5-4bc7-8cba-c5d82919abb1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:13.845187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201daa7-e3d5-4bc7-8cba-c5d82919abb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:13.870340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e201daa7-e3d5-4bc7-8cba-c5d82919abb1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:13.871884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e201daa7-e3d5-4bc7-8cba-c5d82919abb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:13.947292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:13.975610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 235/459] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:51:14.010659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234ec5-905e-4013-9e40-5833d1b91d97 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:14.011348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234ec5-905e-4013-9e40-5833d1b91d97 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:14.011823 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234ec5-905e-4013-9e40-5833d1b91d97 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:14.013691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 225/460] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:14.019519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610ac97-1675-4531-a6ab-359426dcf6a3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:14.020179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610ac97-1675-4531-a6ab-359426dcf6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:14.020684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610ac97-1675-4531-a6ab-359426dcf6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:14.049718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2610ac97-1675-4531-a6ab-359426dcf6a3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:14.050946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2610ac97-1675-4531-a6ab-359426dcf6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:14.153887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 236/461] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:14.223407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a234ec5-905e-4013-9e40-5833d1b91d97 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:14.328513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:14.349981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a234ec5-905e-4013-9e40-5833d1b91d97 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:14.351972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610ac97-1675-4531-a6ab-359426dcf6a3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:14.394994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79177441-26e6-4bbd-92c5-877c92bc3dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:14.395967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79177441-26e6-4bbd-92c5-877c92bc3dbe None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:14.397059 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79177441-26e6-4bbd-92c5-877c92bc3dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:14.397597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79177441-26e6-4bbd-92c5-877c92bc3dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:14.415363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79177441-26e6-4bbd-92c5-877c92bc3dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:14.417444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79177441-26e6-4bbd-92c5-877c92bc3dbe None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-79177441-26e6-4bbd-92c5-877c92bc3dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:14.443168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:14.444173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:14.445093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:14.445093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:14.445093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:14.445093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 226/462] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:14.450922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79177441-26e6-4bbd-92c5-877c92bc3dbe None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:14.575230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610ac97-1675-4531-a6ab-359426dcf6a3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:14.589906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:14.617764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c1657-1c00-4dc8-9be3-9abdbf788f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:14.618765 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1657-1c00-4dc8-9be3-9abdbf788f9b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:14.619269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1657-1c00-4dc8-9be3-9abdbf788f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:14.619770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c1657-1c00-4dc8-9be3-9abdbf788f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:14.625462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79177441-26e6-4bbd-92c5-877c92bc3dbe None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:14.631483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c1657-1c00-4dc8-9be3-9abdbf788f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:14.633212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c1657-1c00-4dc8-9be3-9abdbf788f9b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ec7c1657-1c00-4dc8-9be3-9abdbf788f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:14.649441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:14.650804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:14.651671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:14.651671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:14.651671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:14.659045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 237/463] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:14.660302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c1657-1c00-4dc8-9be3-9abdbf788f9b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:14.670681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd615da-44d5-419f-bf00-59037531d722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:14.671675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd615da-44d5-419f-bf00-59037531d722 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:14.672154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd615da-44d5-419f-bf00-59037531d722 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:14.672692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd615da-44d5-419f-bf00-59037531d722 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:14.673546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd615da-44d5-419f-bf00-59037531d722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:14.674047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd615da-44d5-419f-bf00-59037531d722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:14.675681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd615da-44d5-419f-bf00-59037531d722 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:14.689193 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 227/464] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:14.690350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd615da-44d5-419f-bf00-59037531d722 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:14.693682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:14.803764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c1657-1c00-4dc8-9be3-9abdbf788f9b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:14.851977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd615da-44d5-419f-bf00-59037531d722 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:14.863497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28532b-fe1f-41bd-937d-08c59d3362f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:14.864317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28532b-fe1f-41bd-937d-08c59d3362f9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:14.864793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28532b-fe1f-41bd-937d-08c59d3362f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:14.865437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28532b-fe1f-41bd-937d-08c59d3362f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:14.882584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28532b-fe1f-41bd-937d-08c59d3362f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:14.884968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28532b-fe1f-41bd-937d-08c59d3362f9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:14.902842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261256d-69b8-4bd6-9644-1d3d6b0a4178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:14.903697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261256d-69b8-4bd6-9644-1d3d6b0a4178 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:14.904145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261256d-69b8-4bd6-9644-1d3d6b0a4178 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7b28532b-fe1f-41bd-937d-08c59d3362f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:14.904363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:14.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:14.906129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:14.906129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:14.906129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:14.906129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 238/465] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:14.907097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261256d-69b8-4bd6-9644-1d3d6b0a4178 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:14.907202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28532b-fe1f-41bd-937d-08c59d3362f9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:14.916259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261256d-69b8-4bd6-9644-1d3d6b0a4178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:14.916259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261256d-69b8-4bd6-9644-1d3d6b0a4178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:14.916259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261256d-69b8-4bd6-9644-1d3d6b0a4178 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:14.927850 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:14.930565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 228/466] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:14.932227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121dede-9a40-46a1-8fb3-2adadc8a5513 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:14.932976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121dede-9a40-46a1-8fb3-2adadc8a5513 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:14.933397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121dede-9a40-46a1-8fb3-2adadc8a5513 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:14.935279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 229/467] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:14.936311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121dede-9a40-46a1-8fb3-2adadc8a5513 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:15.038854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:15.046118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28532b-fe1f-41bd-937d-08c59d3362f9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:15.089885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121dede-9a40-46a1-8fb3-2adadc8a5513 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:15.091382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d4494-7bd2-47f9-b411-d0b2884ce2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:15.092000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d4494-7bd2-47f9-b411-d0b2884ce2bb None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:15.092437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d4494-7bd2-47f9-b411-d0b2884ce2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:15.092880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d4494-7bd2-47f9-b411-d0b2884ce2bb None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:15.093722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d4494-7bd2-47f9-b411-d0b2884ce2bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:15.095475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d4494-7bd2-47f9-b411-d0b2884ce2bb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:15.125890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 239/468] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:51:14 2022] POST /identity/v3/users => generated 246 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:51:15.128340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d4494-7bd2-47f9-b411-d0b2884ce2bb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:15.184433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6050b-6c10-4664-9dcb-61a780763d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:15.186481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6050b-6c10-4664-9dcb-61a780763d3f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:15.190267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6050b-6c10-4664-9dcb-61a780763d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:15.191163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6050b-6c10-4664-9dcb-61a780763d3f None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:15.194606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6050b-6c10-4664-9dcb-61a780763d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:15.195573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6050b-6c10-4664-9dcb-61a780763d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:15.200482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6050b-6c10-4664-9dcb-61a780763d3f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:15.254250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 230/469] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:15.259331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e2c86-6f3a-4000-b638-b6d98f6001de None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:15.265482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e2c86-6f3a-4000-b638-b6d98f6001de None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:15.266436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e2c86-6f3a-4000-b638-b6d98f6001de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:15.295843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e53e2c86-6f3a-4000-b638-b6d98f6001de None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:15.297917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e53e2c86-6f3a-4000-b638-b6d98f6001de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:15.331439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:15.387957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 231/470] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:15.389281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e2c86-6f3a-4000-b638-b6d98f6001de None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:15.396789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d4494-7bd2-47f9-b411-d0b2884ce2bb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:15.442433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f8413-dc11-48de-b7b1-52f27ae84801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:15.442982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f8413-dc11-48de-b7b1-52f27ae84801 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:15.443272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f8413-dc11-48de-b7b1-52f27ae84801 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:15.443547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f8413-dc11-48de-b7b1-52f27ae84801 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:15.444214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f8413-dc11-48de-b7b1-52f27ae84801 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:15.446995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f8413-dc11-48de-b7b1-52f27ae84801 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:15.470607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:15.484558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 240/471] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:51:15 2022] POST /identity/v3/users => generated 248 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:51:15.487132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225dea1-6549-4834-864f-b7a9f36fbe8f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:15.487831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225dea1-6549-4834-864f-b7a9f36fbe8f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:15.488419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225dea1-6549-4834-864f-b7a9f36fbe8f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:15.492832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 241/472] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:15.499525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3a6ba-94d3-4530-a4de-c4d2ad254d1d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:15.503823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3a6ba-94d3-4530-a4de-c4d2ad254d1d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:15.505067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3a6ba-94d3-4530-a4de-c4d2ad254d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:15.550518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-68d3a6ba-94d3-4530-a4de-c4d2ad254d1d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:15.553652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e2c86-6f3a-4000-b638-b6d98f6001de None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:15.555862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-68d3a6ba-94d3-4530-a4de-c4d2ad254d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:15.613362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca9620-4f1d-4e6a-b4de-30c48e4701b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:15.614008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca9620-4f1d-4e6a-b4de-30c48e4701b8 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:15.614295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca9620-4f1d-4e6a-b4de-30c48e4701b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:15.614573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca9620-4f1d-4e6a-b4de-30c48e4701b8 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:15.615477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca9620-4f1d-4e6a-b4de-30c48e4701b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:15.616980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca9620-4f1d-4e6a-b4de-30c48e4701b8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:15.649717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 232/473] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:51:15 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:51:15.682469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 242/474] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:51:15.692929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca9620-4f1d-4e6a-b4de-30c48e4701b8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:15.833120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca9620-4f1d-4e6a-b4de-30c48e4701b8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:15.844071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:15.874663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda4f31-9a49-40e4-81d0-17e1ebf73ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:15.875342 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda4f31-9a49-40e4-81d0-17e1ebf73ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:15.875630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda4f31-9a49-40e4-81d0-17e1ebf73ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:15.875910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda4f31-9a49-40e4-81d0-17e1ebf73ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:15.890124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda4f31-9a49-40e4-81d0-17e1ebf73ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:15.891610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda4f31-9a49-40e4-81d0-17e1ebf73ae6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-2dda4f31-9a49-40e4-81d0-17e1ebf73ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:15.908917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:15.909897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:15.910767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:15.910767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:15.910767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:15.910767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 233/475] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:15.915885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3a6ba-94d3-4530-a4de-c4d2ad254d1d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:15.981534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda4f31-9a49-40e4-81d0-17e1ebf73ae6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:15.985584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:16.048335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3a6ba-94d3-4530-a4de-c4d2ad254d1d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:16.094562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058edc5-36e2-4d68-9df5-399565fed836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:16.095313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058edc5-36e2-4d68-9df5-399565fed836 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:16.096151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058edc5-36e2-4d68-9df5-399565fed836 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:16.096428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058edc5-36e2-4d68-9df5-399565fed836 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:16.097235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058edc5-36e2-4d68-9df5-399565fed836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:16.097541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058edc5-36e2-4d68-9df5-399565fed836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:16.098931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058edc5-36e2-4d68-9df5-399565fed836 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:16.115408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 243/476] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:16.118800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058edc5-36e2-4d68-9df5-399565fed836 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:16.123017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda4f31-9a49-40e4-81d0-17e1ebf73ae6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:16.201160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c532ad0-6520-4956-95f2-c592bf5579f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:16.201838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c532ad0-6520-4956-95f2-c592bf5579f9 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:16.202129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c532ad0-6520-4956-95f2-c592bf5579f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:16.202408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c532ad0-6520-4956-95f2-c592bf5579f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:16.203096 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c532ad0-6520-4956-95f2-c592bf5579f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:16.206761 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c532ad0-6520-4956-95f2-c592bf5579f9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:16.222888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.sql.core [None req-2c532ad0-6520-4956-95f2-c592bf5579f9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 16:51:16.222888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 16:51:16.222888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [parameters: {'id': '80bbc7d485fe4a91aab69ec20a890eb6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 16:51:16.222888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81515) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-2c532ad0-6520-4956-95f2-c592bf5579f9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result.read() Aug 18 16:51:16.258230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return ref.to_dict() Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:51:16.259508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application yield resource Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise self.value Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application session.commit() Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 16:51:16.260452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.session.flush() Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application compat.raise_( Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 16:51:16.261704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:51:16.262604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result.read() Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:51:16.263441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [parameters: {'id': '80bbc7d485fe4a91aab69ec20a890eb6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:16.264256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 16:51:16.270771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:16.272783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 234/477] 10.222.0.81 () {60 vars in 1131 bytes} [Thu Aug 18 16:51:15 2022] POST /identity/v3/roles => generated 144 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:16.279878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c532ad0-6520-4956-95f2-c592bf5579f9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:16.330563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058edc5-36e2-4d68-9df5-399565fed836 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:16.336633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:16.354902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:16.383880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bebc9-b645-4253-8a83-f592703d6b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:16.384984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bebc9-b645-4253-8a83-f592703d6b3f None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:16.386821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bebc9-b645-4253-8a83-f592703d6b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:16.387257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bebc9-b645-4253-8a83-f592703d6b3f None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:16.389194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bebc9-b645-4253-8a83-f592703d6b3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:16.390935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bebc9-b645-4253-8a83-f592703d6b3f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:16.439823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 244/478] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:51:16 2022] POST /identity/v3/users => generated 249 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:51:16.481134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c532ad0-6520-4956-95f2-c592bf5579f9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:16.522236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7e062-64e2-4f93-8443-3373e4e4c32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:16.522828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e062-64e2-4f93-8443-3373e4e4c32a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:16.523114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e062-64e2-4f93-8443-3373e4e4c32a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:16.523394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e062-64e2-4f93-8443-3373e4e4c32a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:16.536350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7e062-64e2-4f93-8443-3373e4e4c32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9ed7e062-64e2-4f93-8443-3373e4e4c32a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:16.541700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:16.542883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:16.543796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 235/479] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:51:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:16.549491 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bebc9-b645-4253-8a83-f592703d6b3f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:16.699912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bebc9-b645-4253-8a83-f592703d6b3f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:16.745694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6c48d-b673-4bf1-88e0-ed827ae30adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:16.746541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c48d-b673-4bf1-88e0-ed827ae30adf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:16.747022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c48d-b673-4bf1-88e0-ed827ae30adf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:16.747482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c48d-b673-4bf1-88e0-ed827ae30adf None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:16.748329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6c48d-b673-4bf1-88e0-ed827ae30adf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:16.748823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6c48d-b673-4bf1-88e0-ed827ae30adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:16.750394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6c48d-b673-4bf1-88e0-ed827ae30adf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:16.760739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 245/480] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:17.587474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548647-5c73-4a98-b252-ed794643d2bd None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:17.588004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548647-5c73-4a98-b252-ed794643d2bd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:17.588004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548647-5c73-4a98-b252-ed794643d2bd None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:17.589702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 236/481] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:17.606986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd64191-fc7a-47df-9430-b734df5ca2a1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:17.607320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd64191-fc7a-47df-9430-b734df5ca2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:17.607560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd64191-fc7a-47df-9430-b734df5ca2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:17.637633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-dfd64191-fc7a-47df-9430-b734df5ca2a1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:17.638881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dfd64191-fc7a-47df-9430-b734df5ca2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:17.678412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:17.728584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 246/482] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:51:18.004228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548647-5c73-4a98-b252-ed794643d2bd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:18.129789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:18.139917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa5c5d-fcc9-4a9c-a7ee-8f6958ee9750 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:18.140273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa5c5d-fcc9-4a9c-a7ee-8f6958ee9750 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:18.140505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa5c5d-fcc9-4a9c-a7ee-8f6958ee9750 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:18.142187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 247/483] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:51:18.147684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692cc0-42ca-4247-86a6-798093139446 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:18.148249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692cc0-42ca-4247-86a6-798093139446 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:18.148778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692cc0-42ca-4247-86a6-798093139446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:18.165364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548647-5c73-4a98-b252-ed794643d2bd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:18.192736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d5692cc0-42ca-4247-86a6-798093139446 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:18.193943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d5692cc0-42ca-4247-86a6-798093139446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:18.208868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f996c-4d39-4cb8-af3a-a45ea2df6bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:18.209753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f996c-4d39-4cb8-af3a-a45ea2df6bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:18.210047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f996c-4d39-4cb8-af3a-a45ea2df6bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:18.210328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f996c-4d39-4cb8-af3a-a45ea2df6bd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:18.224232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f996c-4d39-4cb8-af3a-a45ea2df6bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f12f996c-4d39-4cb8-af3a-a45ea2df6bd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:18.231052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:18.231994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:18.232847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:18.236560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 237/484] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:18.238763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fea6b-a85c-494b-861e-3344896fe21f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:18.239305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fea6b-a85c-494b-861e-3344896fe21f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:18.240034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fea6b-a85c-494b-861e-3344896fe21f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:18.242355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 238/485] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:18.243115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fea6b-a85c-494b-861e-3344896fe21f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:18.279475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 248/486] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:51:18.280819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405c53d-2c09-42d5-a864-917de3247ba7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:18.281108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405c53d-2c09-42d5-a864-917de3247ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:18.281477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405c53d-2c09-42d5-a864-917de3247ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:18.317561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2405c53d-2c09-42d5-a864-917de3247ba7 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:18.332968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2405c53d-2c09-42d5-a864-917de3247ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:18.363920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fea6b-a85c-494b-861e-3344896fe21f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:18.405212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac0649-d315-482d-9718-9219086726ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:18.406243 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0649-d315-482d-9718-9219086726ce None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:18.406749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0649-d315-482d-9718-9219086726ce None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:18.407267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac0649-d315-482d-9718-9219086726ce None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:18.408196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac0649-d315-482d-9718-9219086726ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:18.408757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac0649-d315-482d-9718-9219086726ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:18.410601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac0649-d315-482d-9718-9219086726ce None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:18.422753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 239/487] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:18.433557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac0649-d315-482d-9718-9219086726ce None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:18.449583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:18.459481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 249/488] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:18.546117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac0649-d315-482d-9718-9219086726ce None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:18.581985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6555e09-eee7-4bd7-849e-9832da17fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:18.582990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6555e09-eee7-4bd7-849e-9832da17fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:18.583484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6555e09-eee7-4bd7-849e-9832da17fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:18.583960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6555e09-eee7-4bd7-849e-9832da17fdd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:18.596081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6555e09-eee7-4bd7-849e-9832da17fdd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:18.598374 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6555e09-eee7-4bd7-849e-9832da17fdd0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e6555e09-eee7-4bd7-849e-9832da17fdd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:18.613129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:18.614037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:18.615233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:18.615233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:18.615233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:18.617271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 240/489] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:18.624497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405c53d-2c09-42d5-a864-917de3247ba7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:18.660567 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6555e09-eee7-4bd7-849e-9832da17fdd0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:18.676725 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:18.738378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:18.790425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6555e09-eee7-4bd7-849e-9832da17fdd0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:18.794705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405c53d-2c09-42d5-a864-917de3247ba7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:18.832109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dbe45-d547-4e90-9028-c37f208659c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:18.833275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dbe45-d547-4e90-9028-c37f208659c7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:18.834596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dbe45-d547-4e90-9028-c37f208659c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:18.835658 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dbe45-d547-4e90-9028-c37f208659c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:18.841753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc5a65-0690-4cfe-8d27-b003f792cd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:18.842405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc5a65-0690-4cfe-8d27-b003f792cd8b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:18.842812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc5a65-0690-4cfe-8d27-b003f792cd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:18.843091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc5a65-0690-4cfe-8d27-b003f792cd8b None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:18.843890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc5a65-0690-4cfe-8d27-b003f792cd8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:18.844197 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc5a65-0690-4cfe-8d27-b003f792cd8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:18.847232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc5a65-0690-4cfe-8d27-b003f792cd8b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:18.852189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dbe45-d547-4e90-9028-c37f208659c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-995dbe45-d547-4e90-9028-c37f208659c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:18.858891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:18.859926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:18.861491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:18.862127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 250/490] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:18.862127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc5a65-0690-4cfe-8d27-b003f792cd8b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:18.864633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 241/491] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:18.876717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dbe45-d547-4e90-9028-c37f208659c7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:18.985353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:19.005513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dbe45-d547-4e90-9028-c37f208659c7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.009731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc5a65-0690-4cfe-8d27-b003f792cd8b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.024882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:19.050353 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ad802-223f-4d73-a2db-f6364ba318fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.051362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ad802-223f-4d73-a2db-f6364ba318fe None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.051847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ad802-223f-4d73-a2db-f6364ba318fe None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.052321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ad802-223f-4d73-a2db-f6364ba318fe None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.052521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8665e-dc78-4671-bbc5-7b90ccf13182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.053131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8665e-dc78-4671-bbc5-7b90ccf13182 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.053411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8665e-dc78-4671-bbc5-7b90ccf13182 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.053684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8665e-dc78-4671-bbc5-7b90ccf13182 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.054050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ad802-223f-4d73-a2db-f6364ba318fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:19.054548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ad802-223f-4d73-a2db-f6364ba318fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:19.056984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ad802-223f-4d73-a2db-f6364ba318fe None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:19.066515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8665e-dc78-4671-bbc5-7b90ccf13182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:19.068649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 242/492] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:19.069756 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ad802-223f-4d73-a2db-f6364ba318fe None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-71f8665e-dc78-4671-bbc5-7b90ccf13182 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:19.071934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:19.072915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:19.073728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:19.078093 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 251/493] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:19.078980 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8665e-dc78-4671-bbc5-7b90ccf13182 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:19.185408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8665e-dc78-4671-bbc5-7b90ccf13182 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.199674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ad802-223f-4d73-a2db-f6364ba318fe None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.220629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172928ec-0021-4840-bc7f-dceb21c57708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.221270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172928ec-0021-4840-bc7f-dceb21c57708 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.221549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172928ec-0021-4840-bc7f-dceb21c57708 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.221824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172928ec-0021-4840-bc7f-dceb21c57708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.233449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172928ec-0021-4840-bc7f-dceb21c57708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:19.234910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172928ec-0021-4840-bc7f-dceb21c57708 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:19.236831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08633fc-4b37-4f7a-9d4e-0635d555a568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.237471 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08633fc-4b37-4f7a-9d4e-0635d555a568 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.237750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08633fc-4b37-4f7a-9d4e-0635d555a568 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.238020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08633fc-4b37-4f7a-9d4e-0635d555a568 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.238833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:19.246610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08633fc-4b37-4f7a-9d4e-0635d555a568 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:19.248136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08633fc-4b37-4f7a-9d4e-0635d555a568 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-172928ec-0021-4840-bc7f-dceb21c57708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:19.255222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:19.256135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:19.257026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:19.257026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:19.257026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:19.262794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 252/494] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:19.262794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172928ec-0021-4840-bc7f-dceb21c57708 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a08633fc-4b37-4f7a-9d4e-0635d555a568 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:19.262985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:19.263839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 243/495] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Aug 18 16:51:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1864c47-fc8a-49da-ac9f-846aa4aec250 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.264803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1864c47-fc8a-49da-ac9f-846aa4aec250 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.265484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1864c47-fc8a-49da-ac9f-846aa4aec250 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.270721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 244/496] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:19.270721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1864c47-fc8a-49da-ac9f-846aa4aec250 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:19.318553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:19.373857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172928ec-0021-4840-bc7f-dceb21c57708 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.382558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1864c47-fc8a-49da-ac9f-846aa4aec250 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.408974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9fe8a-844f-4be5-a7c1-78ae7e14742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.409606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9fe8a-844f-4be5-a7c1-78ae7e14742e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.409894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9fe8a-844f-4be5-a7c1-78ae7e14742e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.410170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9fe8a-844f-4be5-a7c1-78ae7e14742e None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.410848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9fe8a-844f-4be5-a7c1-78ae7e14742e None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:19.411160 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9fe8a-844f-4be5-a7c1-78ae7e14742e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:19.412579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9fe8a-844f-4be5-a7c1-78ae7e14742e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:19.419936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0a27e-46fe-4fca-9b75-b785815ed4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.420598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0a27e-46fe-4fca-9b75-b785815ed4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.420885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0a27e-46fe-4fca-9b75-b785815ed4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.421163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0a27e-46fe-4fca-9b75-b785815ed4e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.421358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 253/497] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:19.421860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0a27e-46fe-4fca-9b75-b785815ed4e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:19.422133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0a27e-46fe-4fca-9b75-b785815ed4e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:19.422621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54f970-9faa-4d33-a6f7-01cfbe220215 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.422890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54f970-9faa-4d33-a6f7-01cfbe220215 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.423181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54f970-9faa-4d33-a6f7-01cfbe220215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.424087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0a27e-46fe-4fca-9b75-b785815ed4e0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:19.436392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 245/498] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:19.437230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0a27e-46fe-4fca-9b75-b785815ed4e0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:19.446412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ca54f970-9faa-4d33-a6f7-01cfbe220215 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:19.447605 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ca54f970-9faa-4d33-a6f7-01cfbe220215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:19.502418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:19.517926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 254/499] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:19.519261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1fb9f-36da-46c1-a310-6e893ce0b2be None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.519645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1fb9f-36da-46c1-a310-6e893ce0b2be None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.519935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1fb9f-36da-46c1-a310-6e893ce0b2be None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.521365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 255/500] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:19.526050 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1fb9f-36da-46c1-a310-6e893ce0b2be None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:19.536944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:19.540499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0a27e-46fe-4fca-9b75-b785815ed4e0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.579747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e101c80-2dc2-4e14-b55c-ac0a110408de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.580366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e101c80-2dc2-4e14-b55c-ac0a110408de None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.580692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e101c80-2dc2-4e14-b55c-ac0a110408de None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.580974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e101c80-2dc2-4e14-b55c-ac0a110408de None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.581717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e101c80-2dc2-4e14-b55c-ac0a110408de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:19.582022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e101c80-2dc2-4e14-b55c-ac0a110408de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:19.583453 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e101c80-2dc2-4e14-b55c-ac0a110408de None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:19.627839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 246/501] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Aug 18 16:51:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:19.628712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e101c80-2dc2-4e14-b55c-ac0a110408de None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:19.639174 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1fb9f-36da-46c1-a310-6e893ce0b2be None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.674942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cc82d-d90a-499d-a23a-9bbfb8f3fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.675577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cc82d-d90a-499d-a23a-9bbfb8f3fa22 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.675862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cc82d-d90a-499d-a23a-9bbfb8f3fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.676139 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cc82d-d90a-499d-a23a-9bbfb8f3fa22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.687216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cc82d-d90a-499d-a23a-9bbfb8f3fa22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:19.688619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cc82d-d90a-499d-a23a-9bbfb8f3fa22 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1f9cc82d-d90a-499d-a23a-9bbfb8f3fa22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:19.703304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:19.704261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:19.705729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:19.705729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:19.705729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:19.705729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 256/502] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:19.706619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917cf6a-e8ee-4d32-8feb-cc50b4f4a85e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.706967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917cf6a-e8ee-4d32-8feb-cc50b4f4a85e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.707306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917cf6a-e8ee-4d32-8feb-cc50b4f4a85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.726947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8917cf6a-e8ee-4d32-8feb-cc50b4f4a85e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:19.728418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8917cf6a-e8ee-4d32-8feb-cc50b4f4a85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:19.740068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e101c80-2dc2-4e14-b55c-ac0a110408de None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.770407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:19.776711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef98a29-3eb0-4039-9028-21c1def996a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.777454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef98a29-3eb0-4039-9028-21c1def996a3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.777794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef98a29-3eb0-4039-9028-21c1def996a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.778067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef98a29-3eb0-4039-9028-21c1def996a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.787944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef98a29-3eb0-4039-9028-21c1def996a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:19.789458 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef98a29-3eb0-4039-9028-21c1def996a3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fef98a29-3eb0-4039-9028-21c1def996a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:19.801208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:19.802154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 247/503] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:19.803095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef98a29-3eb0-4039-9028-21c1def996a3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:19.808197 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 257/504] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:19.809065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917cf6a-e8ee-4d32-8feb-cc50b4f4a85e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:19.826215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:19.912924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917cf6a-e8ee-4d32-8feb-cc50b4f4a85e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.919414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef98a29-3eb0-4039-9028-21c1def996a3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:19.948490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e6772-7832-4dc5-bbd7-81a3daac6346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.949023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e6772-7832-4dc5-bbd7-81a3daac6346 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.949305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e6772-7832-4dc5-bbd7-81a3daac6346 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.949802 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e6772-7832-4dc5-bbd7-81a3daac6346 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.950209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e6772-7832-4dc5-bbd7-81a3daac6346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:19.950511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e6772-7832-4dc5-bbd7-81a3daac6346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:19.951881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e6772-7832-4dc5-bbd7-81a3daac6346 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:19.955736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5b9a-de43-448b-8802-7b7d8b44c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:19.956439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5b9a-de43-448b-8802-7b7d8b44c8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:19.956794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5b9a-de43-448b-8802-7b7d8b44c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:19.957058 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5b9a-de43-448b-8802-7b7d8b44c8c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:19.964514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 258/505] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:19.965341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e6772-7832-4dc5-bbd7-81a3daac6346 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.002134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:20.049787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c5b9a-de43-448b-8802-7b7d8b44c8c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:20.052533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c5b9a-de43-448b-8802-7b7d8b44c8c7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:20.078387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:20.096431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e6772-7832-4dc5-bbd7-81a3daac6346 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:20.131861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d3b3-4ac5-4df8-92fc-deff8072dacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:20.132638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d3b3-4ac5-4df8-92fc-deff8072dacf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:20.132929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d3b3-4ac5-4df8-92fc-deff8072dacf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:20.133208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d3b3-4ac5-4df8-92fc-deff8072dacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:20.149959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d3b3-4ac5-4df8-92fc-deff8072dacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:20.151442 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d3b3-4ac5-4df8-92fc-deff8072dacf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f5f2d3b3-4ac5-4df8-92fc-deff8072dacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:20.167306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:20.168411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:20.169407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:20.169407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:20.169407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:20.169574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 248/506] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:20.169574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5b9a-de43-448b-8802-7b7d8b44c8c7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.172227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 259/507] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:20.172227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d3b3-4ac5-4df8-92fc-deff8072dacf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.252957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:20.271030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5b9a-de43-448b-8802-7b7d8b44c8c7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:20.271423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d3b3-4ac5-4df8-92fc-deff8072dacf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:20.288129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:20.303948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3723ff3-e98b-4889-90f7-7ee8bf9cda63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:20.304513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180ea6-3e61-49fd-9611-04aca3140ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:20.304627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3723ff3-e98b-4889-90f7-7ee8bf9cda63 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:20.304868 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3723ff3-e98b-4889-90f7-7ee8bf9cda63 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:20.305124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180ea6-3e61-49fd-9611-04aca3140ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:20.305215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3723ff3-e98b-4889-90f7-7ee8bf9cda63 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:20.305408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180ea6-3e61-49fd-9611-04aca3140ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:20.305821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180ea6-3e61-49fd-9611-04aca3140ed6 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:20.306543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180ea6-3e61-49fd-9611-04aca3140ed6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:20.306856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180ea6-3e61-49fd-9611-04aca3140ed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:20.308381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180ea6-3e61-49fd-9611-04aca3140ed6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:20.313700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3723ff3-e98b-4889-90f7-7ee8bf9cda63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:20.315611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3723ff3-e98b-4889-90f7-7ee8bf9cda63 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:20.326962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 249/508] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Aug 18 16:51:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:20.327781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180ea6-3e61-49fd-9611-04aca3140ed6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f3723ff3-e98b-4889-90f7-7ee8bf9cda63 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:20.328105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:20.329010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 260/509] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:20.335404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3723ff3-e98b-4889-90f7-7ee8bf9cda63 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.426534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180ea6-3e61-49fd-9611-04aca3140ed6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:20.427487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3723ff3-e98b-4889-90f7-7ee8bf9cda63 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:20.460080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69825816-23d4-44c6-8ae4-688f0f7f04d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:20.460744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69825816-23d4-44c6-8ae4-688f0f7f04d2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:20.461028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69825816-23d4-44c6-8ae4-688f0f7f04d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:20.461303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69825816-23d4-44c6-8ae4-688f0f7f04d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:20.461522 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6e7cf-02d9-4418-82ed-04258102fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:20.462150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6e7cf-02d9-4418-82ed-04258102fedb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:20.462429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6e7cf-02d9-4418-82ed-04258102fedb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:20.462701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6e7cf-02d9-4418-82ed-04258102fedb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:20.471731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69825816-23d4-44c6-8ae4-688f0f7f04d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:20.473555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6e7cf-02d9-4418-82ed-04258102fedb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:20.475000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6e7cf-02d9-4418-82ed-04258102fedb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-69825816-23d4-44c6-8ae4-688f0f7f04d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:20.476413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:20.477322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:20.478148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 250/510] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:20.478900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69825816-23d4-44c6-8ae4-688f0f7f04d2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.481193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e3e6e7cf-02d9-4418-82ed-04258102fedb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:20.491303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:20.492334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:20.498061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:20.498061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:20.498061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:20.498061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 261/511] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:20.498061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6e7cf-02d9-4418-82ed-04258102fedb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.513813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:20.577626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69825816-23d4-44c6-8ae4-688f0f7f04d2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:20.596369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6e7cf-02d9-4418-82ed-04258102fedb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:20.612077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af19d-e2f5-43ba-8c2a-31718e61e422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:20.612721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af19d-e2f5-43ba-8c2a-31718e61e422 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:20.613001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af19d-e2f5-43ba-8c2a-31718e61e422 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:20.613275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af19d-e2f5-43ba-8c2a-31718e61e422 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:20.613923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af19d-e2f5-43ba-8c2a-31718e61e422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:20.614226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af19d-e2f5-43ba-8c2a-31718e61e422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:20.615893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af19d-e2f5-43ba-8c2a-31718e61e422 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:20.627989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 251/512] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:20.629028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af19d-e2f5-43ba-8c2a-31718e61e422 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.631299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9825f4-6ab8-4c48-a317-da748ab696a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:20.631921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9825f4-6ab8-4c48-a317-da748ab696a1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:20.632204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9825f4-6ab8-4c48-a317-da748ab696a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:20.632595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9825f4-6ab8-4c48-a317-da748ab696a1 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:20.633345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9825f4-6ab8-4c48-a317-da748ab696a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:20.633658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9825f4-6ab8-4c48-a317-da748ab696a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:20.635103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9825f4-6ab8-4c48-a317-da748ab696a1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:20.672505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 262/513] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Aug 18 16:51:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:20.673272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9825f4-6ab8-4c48-a317-da748ab696a1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.727437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:20.737519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:20.744060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af19d-e2f5-43ba-8c2a-31718e61e422 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:20.778289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e758432-7ca4-440d-afca-8e58a892faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:20.778834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e758432-7ca4-440d-afca-8e58a892faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:20.779120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e758432-7ca4-440d-afca-8e58a892faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:20.779397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e758432-7ca4-440d-afca-8e58a892faf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:20.783866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9825f4-6ab8-4c48-a317-da748ab696a1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:20.818278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71eb2d-33b4-4a05-b100-b9c3a9dbd61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:20.818915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71eb2d-33b4-4a05-b100-b9c3a9dbd61f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:20.819148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71eb2d-33b4-4a05-b100-b9c3a9dbd61f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:20.819422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71eb2d-33b4-4a05-b100-b9c3a9dbd61f None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:20.820131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71eb2d-33b4-4a05-b100-b9c3a9dbd61f None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:20.820437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71eb2d-33b4-4a05-b100-b9c3a9dbd61f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:20.821858 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71eb2d-33b4-4a05-b100-b9c3a9dbd61f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:20.830671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 263/514] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:20.831270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71eb2d-33b4-4a05-b100-b9c3a9dbd61f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.848553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e758432-7ca4-440d-afca-8e58a892faf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:20.850031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e758432-7ca4-440d-afca-8e58a892faf7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:20.930130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71eb2d-33b4-4a05-b100-b9c3a9dbd61f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:20.943396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:20.944078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:20.950652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 252/515] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:20.951627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e758432-7ca4-440d-afca-8e58a892faf7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:20.967701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aa9c2-c07c-4742-a4aa-5a6433ae4d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:20.968317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa9c2-c07c-4742-a4aa-5a6433ae4d2f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:20.968632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa9c2-c07c-4742-a4aa-5a6433ae4d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:20.968970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aa9c2-c07c-4742-a4aa-5a6433ae4d2f None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:20.969620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aa9c2-c07c-4742-a4aa-5a6433ae4d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:20.969929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aa9c2-c07c-4742-a4aa-5a6433ae4d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:20.971339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aa9c2-c07c-4742-a4aa-5a6433ae4d2f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:20.983508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 264/516] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:20.984346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aa9c2-c07c-4742-a4aa-5a6433ae4d2f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:21.057281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e758432-7ca4-440d-afca-8e58a892faf7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:21.083110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aa9c2-c07c-4742-a4aa-5a6433ae4d2f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:21.094237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5567554-a081-45fd-8433-5a0d2f9c8cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:21.095004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567554-a081-45fd-8433-5a0d2f9c8cec None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:21.095304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567554-a081-45fd-8433-5a0d2f9c8cec None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:21.095573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567554-a081-45fd-8433-5a0d2f9c8cec None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:21.096208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5567554-a081-45fd-8433-5a0d2f9c8cec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:21.097673 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5567554-a081-45fd-8433-5a0d2f9c8cec None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:21.117146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64522a2c-3ca5-460e-a476-1db06ff663b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:21.117752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64522a2c-3ca5-460e-a476-1db06ff663b6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:21.118037 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64522a2c-3ca5-460e-a476-1db06ff663b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:21.118321 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64522a2c-3ca5-460e-a476-1db06ff663b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:21.118502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 253/517] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:51:20 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:51:21.119317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5567554-a081-45fd-8433-5a0d2f9c8cec None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:21.181340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:21.184899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:21.215891 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64522a2c-3ca5-460e-a476-1db06ff663b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:21.217562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64522a2c-3ca5-460e-a476-1db06ff663b6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:21.243536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5567554-a081-45fd-8433-5a0d2f9c8cec None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:21.291320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506cd25-cf18-4528-943b-cbb66dbc7519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:21.291986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506cd25-cf18-4528-943b-cbb66dbc7519 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:21.292606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506cd25-cf18-4528-943b-cbb66dbc7519 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:21.292718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506cd25-cf18-4528-943b-cbb66dbc7519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:21.309362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506cd25-cf18-4528-943b-cbb66dbc7519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:21.310781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506cd25-cf18-4528-943b-cbb66dbc7519 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1506cd25-cf18-4528-943b-cbb66dbc7519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:21.328689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:21.330225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:21.331534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:21.331534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:21.331534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:21.331534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 254/518] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:21.331534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506cd25-cf18-4528-943b-cbb66dbc7519 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:21.352422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 265/519] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:21.353221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64522a2c-3ca5-460e-a476-1db06ff663b6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:21.440783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:21.443974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506cd25-cf18-4528-943b-cbb66dbc7519 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:21.447530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:21.469262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64522a2c-3ca5-460e-a476-1db06ff663b6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:21.482694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27c7d4-a66e-40a1-b2f5-805cf93c89e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:21.483390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27c7d4-a66e-40a1-b2f5-805cf93c89e1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:21.483671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27c7d4-a66e-40a1-b2f5-805cf93c89e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:21.483955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27c7d4-a66e-40a1-b2f5-805cf93c89e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:21.495532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27c7d4-a66e-40a1-b2f5-805cf93c89e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:21.497108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27c7d4-a66e-40a1-b2f5-805cf93c89e1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:21.507267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03355de3-7aa9-4524-802b-65bbfbae3656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:21.507972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03355de3-7aa9-4524-802b-65bbfbae3656 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:21.508257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03355de3-7aa9-4524-802b-65bbfbae3656 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:21.508630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03355de3-7aa9-4524-802b-65bbfbae3656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-3a27c7d4-a66e-40a1-b2f5-805cf93c89e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:21.513642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:21.514562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:21.515449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:21.515449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:21.515449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:21.515449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 255/520] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:21.515680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27c7d4-a66e-40a1-b2f5-805cf93c89e1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:21.520882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03355de3-7aa9-4524-802b-65bbfbae3656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:21.522366 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03355de3-7aa9-4524-802b-65bbfbae3656 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-03355de3-7aa9-4524-802b-65bbfbae3656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:21.535055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:21.535943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:21.536834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:21.536834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:21.536834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:21.536834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:21.536834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:21.536834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:21.536834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:21.536834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:21.536834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 266/521] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:21.537310 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03355de3-7aa9-4524-802b-65bbfbae3656 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:21.643349 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27c7d4-a66e-40a1-b2f5-805cf93c89e1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:21.650803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03355de3-7aa9-4524-802b-65bbfbae3656 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:21.681095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64cd19-7d08-41a7-87e5-3ce88addf7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:21.681716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64cd19-7d08-41a7-87e5-3ce88addf7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:21.682000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64cd19-7d08-41a7-87e5-3ce88addf7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:21.682277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64cd19-7d08-41a7-87e5-3ce88addf7b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:21.682927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64cd19-7d08-41a7-87e5-3ce88addf7b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:21.683234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64cd19-7d08-41a7-87e5-3ce88addf7b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:21.684624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64cd19-7d08-41a7-87e5-3ce88addf7b1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:21.685119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd11fb-098a-49d4-9ae5-de502012ea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:21.685749 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd11fb-098a-49d4-9ae5-de502012ea77 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:21.686030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd11fb-098a-49d4-9ae5-de502012ea77 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:21.686305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd11fb-098a-49d4-9ae5-de502012ea77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:21.688168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:21.698270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd11fb-098a-49d4-9ae5-de502012ea77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:21.699747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd11fb-098a-49d4-9ae5-de502012ea77 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:21.703826 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 256/522] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:21.704663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64cd19-7d08-41a7-87e5-3ce88addf7b1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-82fd11fb-098a-49d4-9ae5-de502012ea77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:21.717531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:21.718477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:21.719340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:21.719340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:21.719340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:21.719340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 267/523] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:21.719594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd11fb-098a-49d4-9ae5-de502012ea77 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:21.733494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:21.827479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64cd19-7d08-41a7-87e5-3ce88addf7b1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:21.829043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd11fb-098a-49d4-9ae5-de502012ea77 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:21.865354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecad8c-cd4c-4a2b-ad02-e23a4540435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:21.866013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecad8c-cd4c-4a2b-ad02-e23a4540435f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:21.866346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecad8c-cd4c-4a2b-ad02-e23a4540435f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:21.866570 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecad8c-cd4c-4a2b-ad02-e23a4540435f None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:21.867383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecad8c-cd4c-4a2b-ad02-e23a4540435f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:21.867547 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecad8c-cd4c-4a2b-ad02-e23a4540435f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:21.868005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ba469-a678-44c6-a275-1a40937771b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:21.868650 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ba469-a678-44c6-a275-1a40937771b1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:21.868936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ba469-a678-44c6-a275-1a40937771b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:21.869026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecad8c-cd4c-4a2b-ad02-e23a4540435f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:21.869216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ba469-a678-44c6-a275-1a40937771b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:21.869907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ba469-a678-44c6-a275-1a40937771b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:21.870423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ba469-a678-44c6-a275-1a40937771b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:21.872298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ba469-a678-44c6-a275-1a40937771b1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:21.884753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 257/524] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:21.884753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecad8c-cd4c-4a2b-ad02-e23a4540435f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:21.897875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 268/525] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:21.897875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ba469-a678-44c6-a275-1a40937771b1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:21.947101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:21.973546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:21.997635 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecad8c-cd4c-4a2b-ad02-e23a4540435f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:22.004595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ba469-a678-44c6-a275-1a40937771b1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:22.034611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32667e-8670-407a-b31a-4afde09cd2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:22.035254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32667e-8670-407a-b31a-4afde09cd2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:22.035533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32667e-8670-407a-b31a-4afde09cd2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:22.035813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32667e-8670-407a-b31a-4afde09cd2d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:22.041783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ab2b6-b307-45f7-a92c-2b1b66c2a1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:22.042454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ab2b6-b307-45f7-a92c-2b1b66c2a1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:22.042690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ab2b6-b307-45f7-a92c-2b1b66c2a1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:22.042973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ab2b6-b307-45f7-a92c-2b1b66c2a1e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:22.043627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ab2b6-b307-45f7-a92c-2b1b66c2a1e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:22.043859 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32667e-8670-407a-b31a-4afde09cd2d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:22.043955 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ab2b6-b307-45f7-a92c-2b1b66c2a1e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:22.045623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ab2b6-b307-45f7-a92c-2b1b66c2a1e6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:22.045860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32667e-8670-407a-b31a-4afde09cd2d2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ea32667e-8670-407a-b31a-4afde09cd2d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:22.057979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:22.059061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 258/526] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:22.059967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32667e-8670-407a-b31a-4afde09cd2d2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:22.068338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 269/527] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:22.068338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ab2b6-b307-45f7-a92c-2b1b66c2a1e6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:22.174461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32667e-8670-407a-b31a-4afde09cd2d2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:22.175270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ab2b6-b307-45f7-a92c-2b1b66c2a1e6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:22.185141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:22.214065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f210d-962b-4d50-b342-4946bb2b4702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:22.214702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f210d-962b-4d50-b342-4946bb2b4702 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:22.214983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f210d-962b-4d50-b342-4946bb2b4702 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:22.215257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f210d-962b-4d50-b342-4946bb2b4702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:22.215563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ef075-0235-4d1a-b05f-8e2daba6b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:22.216177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ef075-0235-4d1a-b05f-8e2daba6b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:22.216482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ef075-0235-4d1a-b05f-8e2daba6b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:22.216782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ef075-0235-4d1a-b05f-8e2daba6b8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:22.217511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ef075-0235-4d1a-b05f-8e2daba6b8f1 None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=c425b390c8dc4d799270fdd095be78b4) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:22.217822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ef075-0235-4d1a-b05f-8e2daba6b8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:22.218471 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:22.219336 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ef075-0235-4d1a-b05f-8e2daba6b8f1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:22.223358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f210d-962b-4d50-b342-4946bb2b4702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:22.225499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f210d-962b-4d50-b342-4946bb2b4702 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:22.236715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 270/528] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:22 2022] GET /identity/v3/role_assignments?user.id=c425b390c8dc4d799270fdd095be78b4&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:22.236715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ef075-0235-4d1a-b05f-8e2daba6b8f1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d71f210d-962b-4d50-b342-4946bb2b4702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:22.254708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:22.255728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:22.256602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:22.256602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:22.256602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:22.256602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:22.256602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:22.256602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:22.256602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:22.256602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:22.256602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 259/529] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:22.258562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f210d-962b-4d50-b342-4946bb2b4702 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:22.379032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ef075-0235-4d1a-b05f-8e2daba6b8f1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:22.414079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f210d-962b-4d50-b342-4946bb2b4702 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:22.428885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7630fc-6cb6-472d-a882-945ee5f12e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:22.429481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7630fc-6cb6-472d-a882-945ee5f12e17 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:22.429758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7630fc-6cb6-472d-a882-945ee5f12e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:22.430052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7630fc-6cb6-472d-a882-945ee5f12e17 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:22.430912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7630fc-6cb6-472d-a882-945ee5f12e17 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:22.431285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7630fc-6cb6-472d-a882-945ee5f12e17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:22.433237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7630fc-6cb6-472d-a882-945ee5f12e17 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:22.452851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 271/530] 10.222.0.81 () {56 vars in 1139 bytes} [Thu Aug 18 16:51:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:22.453708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7630fc-6cb6-472d-a882-945ee5f12e17 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:22.478120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524179-3d45-42a9-a403-2af136c3de34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:22.479579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524179-3d45-42a9-a403-2af136c3de34 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:22.480371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524179-3d45-42a9-a403-2af136c3de34 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:22.481192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524179-3d45-42a9-a403-2af136c3de34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:22.485299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:22.495425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef524179-3d45-42a9-a403-2af136c3de34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:22.498509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef524179-3d45-42a9-a403-2af136c3de34 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ef524179-3d45-42a9-a403-2af136c3de34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:22.518388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:22.520094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:22.521893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:22.521893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:22.521893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:22.521893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:22.521893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:22.521893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:22.521893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:22.521893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:22.533303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 260/531] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:22.536869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524179-3d45-42a9-a403-2af136c3de34 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:22.575046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7630fc-6cb6-472d-a882-945ee5f12e17 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:22.624488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd508c-42fa-418f-b940-75734e7a8875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:22.624488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd508c-42fa-418f-b940-75734e7a8875 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:22.624488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd508c-42fa-418f-b940-75734e7a8875 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:22.624488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd508c-42fa-418f-b940-75734e7a8875 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:22.624893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd508c-42fa-418f-b940-75734e7a8875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:22.624893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd508c-42fa-418f-b940-75734e7a8875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:22.625411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd508c-42fa-418f-b940-75734e7a8875 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:22.631971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:22.647629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 272/532] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:22.648733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd508c-42fa-418f-b940-75734e7a8875 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:22.683909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524179-3d45-42a9-a403-2af136c3de34 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:22.720403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437461b6-6b15-43d3-b4b3-d6cc81ef8b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:22.721461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437461b6-6b15-43d3-b4b3-d6cc81ef8b01 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:22.721985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437461b6-6b15-43d3-b4b3-d6cc81ef8b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:22.722493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437461b6-6b15-43d3-b4b3-d6cc81ef8b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:22.770438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:22.781909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd508c-42fa-418f-b940-75734e7a8875 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:22.797868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437461b6-6b15-43d3-b4b3-d6cc81ef8b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:22.800328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437461b6-6b15-43d3-b4b3-d6cc81ef8b01 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:22.819879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc674ba7-c86d-4558-897f-dd9224efafee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:22.820439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc674ba7-c86d-4558-897f-dd9224efafee None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:22.820753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc674ba7-c86d-4558-897f-dd9224efafee None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:22.821036 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc674ba7-c86d-4558-897f-dd9224efafee None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:22.821874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc674ba7-c86d-4558-897f-dd9224efafee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:22.822049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc674ba7-c86d-4558-897f-dd9224efafee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:22.823494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc674ba7-c86d-4558-897f-dd9224efafee None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:22.836796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 273/533] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:22.837639 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc674ba7-c86d-4558-897f-dd9224efafee None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:22.870103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:22.930400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 261/534] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:22.931427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437461b6-6b15-43d3-b4b3-d6cc81ef8b01 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:22.967019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc674ba7-c86d-4558-897f-dd9224efafee None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:23.017882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157abf78-4629-4f83-a7be-ee489146eb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:23.018746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157abf78-4629-4f83-a7be-ee489146eb2a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:23.019612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157abf78-4629-4f83-a7be-ee489146eb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:23.020041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157abf78-4629-4f83-a7be-ee489146eb2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:23.021353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157abf78-4629-4f83-a7be-ee489146eb2a None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=2aa331983fbc4b18b7880084adcba3c5) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:23.022445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157abf78-4629-4f83-a7be-ee489146eb2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:23.024827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157abf78-4629-4f83-a7be-ee489146eb2a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:23.032938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 274/535] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:22 2022] GET /identity/v3/role_assignments?user.id=2aa331983fbc4b18b7880084adcba3c5&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:23.034596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157abf78-4629-4f83-a7be-ee489146eb2a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:23.048350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437461b6-6b15-43d3-b4b3-d6cc81ef8b01 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:23.055173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:23.102921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5873c-3c3e-42af-8499-2932bfffd80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:23.103558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5873c-3c3e-42af-8499-2932bfffd80f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:23.103847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5873c-3c3e-42af-8499-2932bfffd80f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:23.104128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5873c-3c3e-42af-8499-2932bfffd80f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:23.104951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5873c-3c3e-42af-8499-2932bfffd80f None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=a710cfeadd004a8bbf932f6bb3b211e5) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:23.105271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5873c-3c3e-42af-8499-2932bfffd80f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:23.107776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5873c-3c3e-42af-8499-2932bfffd80f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:23.116289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 262/536] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:22 2022] GET /identity/v3/role_assignments?user.id=a710cfeadd004a8bbf932f6bb3b211e5&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:23.117999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8b4c0-2d49-4441-a4ed-8532be8f0899 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:23.118289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8b4c0-2d49-4441-a4ed-8532be8f0899 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:23.118571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8b4c0-2d49-4441-a4ed-8532be8f0899 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:23.124718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 263/537] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:23.126174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7a80f-4f03-4a3e-9d77-25b76198cf76 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:23.126447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7a80f-4f03-4a3e-9d77-25b76198cf76 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:23.126733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7a80f-4f03-4a3e-9d77-25b76198cf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:23.146073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-aaf7a80f-4f03-4a3e-9d77-25b76198cf76 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:23.147319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-aaf7a80f-4f03-4a3e-9d77-25b76198cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:23.164708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:23.188316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157abf78-4629-4f83-a7be-ee489146eb2a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:23.229451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dcfe3-2aca-406a-9b01-837b2802709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:23.230417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dcfe3-2aca-406a-9b01-837b2802709a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:23.230864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dcfe3-2aca-406a-9b01-837b2802709a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:23.231301 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dcfe3-2aca-406a-9b01-837b2802709a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:23.235234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 264/538] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:23.244271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dcfe3-2aca-406a-9b01-837b2802709a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:23.246107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dcfe3-2aca-406a-9b01-837b2802709a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-097dcfe3-2aca-406a-9b01-837b2802709a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:23.264487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:23.265658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:23.266642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:23.266642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:23.266642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:23.268650 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 275/539] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:23.276491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7a80f-4f03-4a3e-9d77-25b76198cf76 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:23.402657 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7a80f-4f03-4a3e-9d77-25b76198cf76 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:23.440663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707d441-693e-4ccd-bfa7-3febb51a5951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:23.441442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707d441-693e-4ccd-bfa7-3febb51a5951 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:23.441827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707d441-693e-4ccd-bfa7-3febb51a5951 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:23.442206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707d441-693e-4ccd-bfa7-3febb51a5951 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:23.442984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707d441-693e-4ccd-bfa7-3febb51a5951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:23.443396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707d441-693e-4ccd-bfa7-3febb51a5951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:23.444899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707d441-693e-4ccd-bfa7-3febb51a5951 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:23.457997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 265/540] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:23.463464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dcfe3-2aca-406a-9b01-837b2802709a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:23.546702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:23.604095 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dcfe3-2aca-406a-9b01-837b2802709a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:23.631094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707d441-693e-4ccd-bfa7-3febb51a5951 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:23.644821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:23.655735 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd7580-8b13-453d-95e4-a9f0e9df2a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:23.656401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd7580-8b13-453d-95e4-a9f0e9df2a8a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:23.656708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd7580-8b13-453d-95e4-a9f0e9df2a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:23.656988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd7580-8b13-453d-95e4-a9f0e9df2a8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:23.664643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd7580-8b13-453d-95e4-a9f0e9df2a8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:23.666575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd7580-8b13-453d-95e4-a9f0e9df2a8a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f8dd7580-8b13-453d-95e4-a9f0e9df2a8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:23.680157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:23.681283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:23.682450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:23.682450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:23.682450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:23.682450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:23.682450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:23.682450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:23.682450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:23.682450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:23.682450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 276/541] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:23.687207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd7580-8b13-453d-95e4-a9f0e9df2a8a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:23.747345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707d441-693e-4ccd-bfa7-3febb51a5951 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:23.786858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c4d43-623b-49f0-89d3-85eafd8bc857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:23.787685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c4d43-623b-49f0-89d3-85eafd8bc857 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:23.788064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c4d43-623b-49f0-89d3-85eafd8bc857 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:23.788343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c4d43-623b-49f0-89d3-85eafd8bc857 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:23.801269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c4d43-623b-49f0-89d3-85eafd8bc857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-245c4d43-623b-49f0-89d3-85eafd8bc857 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:23.806999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:23.807925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:23.808769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 266/542] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:23.814923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c4d43-623b-49f0-89d3-85eafd8bc857 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:23.888304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:23.895281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd7580-8b13-453d-95e4-a9f0e9df2a8a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:23.921790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:23.944920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b4b5b-4190-4a17-840f-315409d15977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:23.945543 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b4b5b-4190-4a17-840f-315409d15977 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:23.945826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b4b5b-4190-4a17-840f-315409d15977 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:23.946102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b4b5b-4190-4a17-840f-315409d15977 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:23.946805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b4b5b-4190-4a17-840f-315409d15977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:23.947115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b4b5b-4190-4a17-840f-315409d15977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:23.949608 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b4b5b-4190-4a17-840f-315409d15977 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:23.958871 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c4d43-623b-49f0-89d3-85eafd8bc857 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:23.979814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 277/543] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:23.985677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b4b5b-4190-4a17-840f-315409d15977 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:24.013708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c1f15-936b-4a1f-83a3-0982541e98d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:24.014247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c1f15-936b-4a1f-83a3-0982541e98d2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:24.014530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c1f15-936b-4a1f-83a3-0982541e98d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:24.014804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c1f15-936b-4a1f-83a3-0982541e98d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:24.015496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c1f15-936b-4a1f-83a3-0982541e98d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:24.016143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c1f15-936b-4a1f-83a3-0982541e98d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:24.017359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c1f15-936b-4a1f-83a3-0982541e98d2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:24.028506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 267/544] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:24.031433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c1f15-936b-4a1f-83a3-0982541e98d2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:24.161387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c1f15-936b-4a1f-83a3-0982541e98d2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:24.190276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b4b5b-4190-4a17-840f-315409d15977 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:24.219057 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:24.230433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109c908-8c19-40c7-89f0-6b695063b466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:24.231292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109c908-8c19-40c7-89f0-6b695063b466 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:24.231720 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109c908-8c19-40c7-89f0-6b695063b466 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:24.232138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109c908-8c19-40c7-89f0-6b695063b466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:24.251232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109c908-8c19-40c7-89f0-6b695063b466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:24.253513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109c908-8c19-40c7-89f0-6b695063b466 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:24.263252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f58ac6-594b-41e9-87db-3dc423d3b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:24.264115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58ac6-594b-41e9-87db-3dc423d3b27f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:24.264593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58ac6-594b-41e9-87db-3dc423d3b27f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:24.265029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f58ac6-594b-41e9-87db-3dc423d3b27f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:24.265962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f58ac6-594b-41e9-87db-3dc423d3b27f None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=7b1fde904acd460899d8c736f5762056) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:24.266418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f58ac6-594b-41e9-87db-3dc423d3b27f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:24.268583 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f58ac6-594b-41e9-87db-3dc423d3b27f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:24.288646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 278/545] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:23 2022] GET /identity/v3/role_assignments?user.id=7b1fde904acd460899d8c736f5762056&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0109c908-8c19-40c7-89f0-6b695063b466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:24.295824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:24.297017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:24.298076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:24.298076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:24.298076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:24.300444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 268/546] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:24.305961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f58ac6-594b-41e9-87db-3dc423d3b27f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:24.324109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860a5ed-abde-426d-a07e-53120245895c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:24.324797 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860a5ed-abde-426d-a07e-53120245895c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:24.325274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860a5ed-abde-426d-a07e-53120245895c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:24.327076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 269/547] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:24.334670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8e65b-faec-4e5e-8dbf-2696c0becef6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:24.335250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8e65b-faec-4e5e-8dbf-2696c0becef6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:24.335779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8e65b-faec-4e5e-8dbf-2696c0becef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:24.372554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-38e8e65b-faec-4e5e-8dbf-2696c0becef6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:24.373783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-38e8e65b-faec-4e5e-8dbf-2696c0becef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:24.392773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:24.483406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f58ac6-594b-41e9-87db-3dc423d3b27f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:24.499473 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 270/548] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:51:24.531879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133e0d0-10f5-438a-b3a4-3d0471e7eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:24.533354 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133e0d0-10f5-438a-b3a4-3d0471e7eeed None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:24.533818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133e0d0-10f5-438a-b3a4-3d0471e7eeed None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:24.534268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133e0d0-10f5-438a-b3a4-3d0471e7eeed None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:24.535117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133e0d0-10f5-438a-b3a4-3d0471e7eeed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:24.535598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133e0d0-10f5-438a-b3a4-3d0471e7eeed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:24.537199 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133e0d0-10f5-438a-b3a4-3d0471e7eeed None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:24.551208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 279/549] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:24.557466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8e65b-faec-4e5e-8dbf-2696c0becef6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:24.700320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8e65b-faec-4e5e-8dbf-2696c0becef6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:24.718982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:24.752618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87206ed0-b046-4fe0-a4ba-d2cdff123c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:24.753965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206ed0-b046-4fe0-a4ba-d2cdff123c06 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:24.754520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206ed0-b046-4fe0-a4ba-d2cdff123c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:24.754970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87206ed0-b046-4fe0-a4ba-d2cdff123c06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:24.765579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87206ed0-b046-4fe0-a4ba-d2cdff123c06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:24.767807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87206ed0-b046-4fe0-a4ba-d2cdff123c06 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-87206ed0-b046-4fe0-a4ba-d2cdff123c06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:24.790461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:24.791926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:24.793100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:24.793100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:24.793100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:24.793100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:24.793100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:24.793100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:24.793100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:24.793100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:24.793100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:24.793100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:24.796122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133e0d0-10f5-438a-b3a4-3d0471e7eeed None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:24.801118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 271/550] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:24.801679 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87206ed0-b046-4fe0-a4ba-d2cdff123c06 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:24.968623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87206ed0-b046-4fe0-a4ba-d2cdff123c06 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:24.993873 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133e0d0-10f5-438a-b3a4-3d0471e7eeed None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:25.012821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:25.041964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26efc0-2d7a-427c-889d-995211617616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:25.042590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26efc0-2d7a-427c-889d-995211617616 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.042875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26efc0-2d7a-427c-889d-995211617616 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.043156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26efc0-2d7a-427c-889d-995211617616 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.043893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26efc0-2d7a-427c-889d-995211617616 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:25.044203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26efc0-2d7a-427c-889d-995211617616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:25.045679 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26efc0-2d7a-427c-889d-995211617616 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:25.066154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 272/551] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Aug 18 16:51:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:25.066913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fb92a-758f-4d0f-8457-48c6b02571df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:25.067565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb92a-758f-4d0f-8457-48c6b02571df None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.067852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb92a-758f-4d0f-8457-48c6b02571df None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.068129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fb92a-758f-4d0f-8457-48c6b02571df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.077577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26efc0-2d7a-427c-889d-995211617616 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:25.105430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fb92a-758f-4d0f-8457-48c6b02571df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:25.110039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5f2fb92a-758f-4d0f-8457-48c6b02571df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:25.111261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:25.112260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:25.113290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:25.117520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 280/552] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:25.125488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fb92a-758f-4d0f-8457-48c6b02571df None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:25.189398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26efc0-2d7a-427c-889d-995211617616 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:25.238132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38efc6-70b1-4c2f-9ecd-893549dae099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:25.238762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38efc6-70b1-4c2f-9ecd-893549dae099 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.239087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38efc6-70b1-4c2f-9ecd-893549dae099 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.239366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38efc6-70b1-4c2f-9ecd-893549dae099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.340144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38efc6-70b1-4c2f-9ecd-893549dae099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:25.341549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38efc6-70b1-4c2f-9ecd-893549dae099 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:25.356307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fb92a-758f-4d0f-8457-48c6b02571df None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:25.373965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:25.447611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 273/553] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:25.452795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b49ee-e9ed-4c7f-a212-effe3d6f9135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:25.453769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38efc6-70b1-4c2f-9ecd-893549dae099 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:25.458977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b49ee-e9ed-4c7f-a212-effe3d6f9135 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.459265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b49ee-e9ed-4c7f-a212-effe3d6f9135 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.459543 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b49ee-e9ed-4c7f-a212-effe3d6f9135 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.460239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b49ee-e9ed-4c7f-a212-effe3d6f9135 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:25.460579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b49ee-e9ed-4c7f-a212-effe3d6f9135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:25.461987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b49ee-e9ed-4c7f-a212-effe3d6f9135 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:25.475909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 281/554] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:25.489009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b49ee-e9ed-4c7f-a212-effe3d6f9135 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:25.547880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:25.599615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b49ee-e9ed-4c7f-a212-effe3d6f9135 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:25.633029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38efc6-70b1-4c2f-9ecd-893549dae099 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:25.638959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327114d2-ca83-4489-bbc8-b4e826bcf696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:25.639951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327114d2-ca83-4489-bbc8-b4e826bcf696 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.640439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327114d2-ca83-4489-bbc8-b4e826bcf696 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.641012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327114d2-ca83-4489-bbc8-b4e826bcf696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.653601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327114d2-ca83-4489-bbc8-b4e826bcf696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:25.655436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327114d2-ca83-4489-bbc8-b4e826bcf696 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:25.664240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:25.671774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ab2de-a898-40cc-85f2-29a5ba05547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:25.672486 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ab2de-a898-40cc-85f2-29a5ba05547b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.672766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ab2de-a898-40cc-85f2-29a5ba05547b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.673038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ab2de-a898-40cc-85f2-29a5ba05547b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-327114d2-ca83-4489-bbc8-b4e826bcf696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:25.675779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:25.676710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:25.677609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:25.677609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:25.677609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:25.679701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 282/555] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:25.681245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa34261-b710-4522-a94f-88e25ecd7edb None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.681754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa34261-b710-4522-a94f-88e25ecd7edb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.682389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa34261-b710-4522-a94f-88e25ecd7edb None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.684099 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 283/556] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:25.684277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ab2de-a898-40cc-85f2-29a5ba05547b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:25.685186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa34261-b710-4522-a94f-88e25ecd7edb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:25.690087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ab2de-a898-40cc-85f2-29a5ba05547b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-738ab2de-a898-40cc-85f2-29a5ba05547b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:25.707255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:25.708286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:25.709899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:25.709899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:25.709899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:25.709899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 274/557] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:25.711267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba237f32-8573-49ea-a2cc-5a6a6de95590 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.711426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba237f32-8573-49ea-a2cc-5a6a6de95590 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.711744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba237f32-8573-49ea-a2cc-5a6a6de95590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.730982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ba237f32-8573-49ea-a2cc-5a6a6de95590 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:25.732333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ba237f32-8573-49ea-a2cc-5a6a6de95590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:25.781823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:25.802566 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa34261-b710-4522-a94f-88e25ecd7edb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:25.807604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 275/558] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:25.809117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba237f32-8573-49ea-a2cc-5a6a6de95590 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:25.851760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f67b4-a9f2-4206-ad25-a6128da0b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:25.852927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f67b4-a9f2-4206-ad25-a6128da0b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.853377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f67b4-a9f2-4206-ad25-a6128da0b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.853842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f67b4-a9f2-4206-ad25-a6128da0b1d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.854883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f67b4-a9f2-4206-ad25-a6128da0b1d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:25.856250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f67b4-a9f2-4206-ad25-a6128da0b1d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:25.857813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f67b4-a9f2-4206-ad25-a6128da0b1d0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:25.878180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 284/559] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:25.878180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993ead-f1fc-4fc0-9a79-5ba99a965ada None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.878180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993ead-f1fc-4fc0-9a79-5ba99a965ada None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.878485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993ead-f1fc-4fc0-9a79-5ba99a965ada None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.880942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 285/560] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:25.880942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993ead-f1fc-4fc0-9a79-5ba99a965ada None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:25.937255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba237f32-8573-49ea-a2cc-5a6a6de95590 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:25.955155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:25.980946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c3a9-8128-4225-a637-1aeefc56ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:25.981580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c3a9-8128-4225-a637-1aeefc56ab17 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:25.981860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c3a9-8128-4225-a637-1aeefc56ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:25.982133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c3a9-8128-4225-a637-1aeefc56ab17 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:25.982794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45c3a9-8128-4225-a637-1aeefc56ab17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:25.983099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45c3a9-8128-4225-a637-1aeefc56ab17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:25.984622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45c3a9-8128-4225-a637-1aeefc56ab17 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:26.003006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 276/561] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:26.003006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782e41-68ef-4628-9d65-49d22be15c07 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.003006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782e41-68ef-4628-9d65-49d22be15c07 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.003006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782e41-68ef-4628-9d65-49d22be15c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.021379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3a782e41-68ef-4628-9d65-49d22be15c07 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:26.022403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a782e41-68ef-4628-9d65-49d22be15c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:26.025925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993ead-f1fc-4fc0-9a79-5ba99a965ada None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.068890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61966f-a3ab-4a7c-ac65-268f4f10ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.069918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61966f-a3ab-4a7c-ac65-268f4f10ab52 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.070489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61966f-a3ab-4a7c-ac65-268f4f10ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.070962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61966f-a3ab-4a7c-ac65-268f4f10ab52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.080072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61966f-a3ab-4a7c-ac65-268f4f10ab52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:26.082171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61966f-a3ab-4a7c-ac65-268f4f10ab52 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4c61966f-a3ab-4a7c-ac65-268f4f10ab52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:26.096077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:26.097155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:26.098140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:26.098140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:26.098140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:26.098140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:26.098140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:26.098140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:26.098140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:26.098140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:26.098140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:26.098140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:26.099207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 277/562] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:26.099997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782e41-68ef-4628-9d65-49d22be15c07 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:26.105642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 286/563] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Aug 18 16:51:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:26.106925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61966f-a3ab-4a7c-ac65-268f4f10ab52 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:26.110298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:26.216771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782e41-68ef-4628-9d65-49d22be15c07 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.228912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:26.242981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61966f-a3ab-4a7c-ac65-268f4f10ab52 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.253319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594abbc-2bf4-4dc6-b919-3b2a97ff1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.253966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594abbc-2bf4-4dc6-b919-3b2a97ff1698 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.254250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594abbc-2bf4-4dc6-b919-3b2a97ff1698 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.254543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594abbc-2bf4-4dc6-b919-3b2a97ff1698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.262007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594abbc-2bf4-4dc6-b919-3b2a97ff1698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:26.263457 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594abbc-2bf4-4dc6-b919-3b2a97ff1698 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d594abbc-2bf4-4dc6-b919-3b2a97ff1698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:26.275306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:26.276216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:26.277140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:26.277140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:26.277140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:26.277140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:26.277140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:26.277140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:26.277140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:26.277140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:26.280692 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276a020-df60-4f9e-bb48-231d5e969299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.280874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 278/564] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:26.281333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276a020-df60-4f9e-bb48-231d5e969299 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.281614 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276a020-df60-4f9e-bb48-231d5e969299 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.281716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594abbc-2bf4-4dc6-b919-3b2a97ff1698 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:26.281890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276a020-df60-4f9e-bb48-231d5e969299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.293156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276a020-df60-4f9e-bb48-231d5e969299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0276a020-df60-4f9e-bb48-231d5e969299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:26.298656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:26.299595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:26.301495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:26.304738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 287/565] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:26.305477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276a020-df60-4f9e-bb48-231d5e969299 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:26.370907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:26.385448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594abbc-2bf4-4dc6-b919-3b2a97ff1698 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.414107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276a020-df60-4f9e-bb48-231d5e969299 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.422641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419c75-ad1e-40d9-8253-a6d92f724dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.423349 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419c75-ad1e-40d9-8253-a6d92f724dac None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.423633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419c75-ad1e-40d9-8253-a6d92f724dac None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.423958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419c75-ad1e-40d9-8253-a6d92f724dac None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.424724 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4419c75-ad1e-40d9-8253-a6d92f724dac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:26.425029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4419c75-ad1e-40d9-8253-a6d92f724dac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:26.426443 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4419c75-ad1e-40d9-8253-a6d92f724dac None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:26.444560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 279/566] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:26.445457 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419c75-ad1e-40d9-8253-a6d92f724dac None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:26.456845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e1668-b00c-4abe-955a-6a85cbc54f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.457774 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e1668-b00c-4abe-955a-6a85cbc54f91 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.458261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e1668-b00c-4abe-955a-6a85cbc54f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.458815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e1668-b00c-4abe-955a-6a85cbc54f91 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.459689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e1668-b00c-4abe-955a-6a85cbc54f91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:26.460176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e1668-b00c-4abe-955a-6a85cbc54f91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:26.462029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e1668-b00c-4abe-955a-6a85cbc54f91 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:26.471147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:26.475922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 288/567] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:26.476799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e1668-b00c-4abe-955a-6a85cbc54f91 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:26.547193 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419c75-ad1e-40d9-8253-a6d92f724dac None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.576397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e1668-b00c-4abe-955a-6a85cbc54f91 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.581681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d62a2-c73d-4ba6-8bd8-97a66ca105fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.582284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d62a2-c73d-4ba6-8bd8-97a66ca105fc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.582560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d62a2-c73d-4ba6-8bd8-97a66ca105fc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.582831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d62a2-c73d-4ba6-8bd8-97a66ca105fc None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.583484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d62a2-c73d-4ba6-8bd8-97a66ca105fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:26.583796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d62a2-c73d-4ba6-8bd8-97a66ca105fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:26.585179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d62a2-c73d-4ba6-8bd8-97a66ca105fc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:26.592852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 280/568] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:26.593628 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d62a2-c73d-4ba6-8bd8-97a66ca105fc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:26.599270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:26.611670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c88b07-1cae-458d-966b-c9d6d723cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.612410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88b07-1cae-458d-966b-c9d6d723cc41 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.612720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88b07-1cae-458d-966b-c9d6d723cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.612999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88b07-1cae-458d-966b-c9d6d723cc41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.623567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c88b07-1cae-458d-966b-c9d6d723cc41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-40c88b07-1cae-458d-966b-c9d6d723cc41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:26.628375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:26.629376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:26.630493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 289/569] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:26.632571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570282a-4c36-4bc0-abaf-bd48ba3e108c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.632765 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570282a-4c36-4bc0-abaf-bd48ba3e108c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.633044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570282a-4c36-4bc0-abaf-bd48ba3e108c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.636808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 290/570] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:26.638637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570282a-4c36-4bc0-abaf-bd48ba3e108c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:26.685285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:26.703618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d62a2-c73d-4ba6-8bd8-97a66ca105fc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.738774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07333c87-64d4-4b2a-bea5-488c453a925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.739420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333c87-64d4-4b2a-bea5-488c453a925c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.739963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333c87-64d4-4b2a-bea5-488c453a925c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.740592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07333c87-64d4-4b2a-bea5-488c453a925c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.746912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570282a-4c36-4bc0-abaf-bd48ba3e108c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.751635 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07333c87-64d4-4b2a-bea5-488c453a925c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:26.753145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07333c87-64d4-4b2a-bea5-488c453a925c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-07333c87-64d4-4b2a-bea5-488c453a925c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:26.768157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:26.769310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:26.770237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:26.770237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:26.770237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:26.770237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 281/571] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:26.770237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07333c87-64d4-4b2a-bea5-488c453a925c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:26.786034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf8511-40f4-4ca6-a0ae-f62d1c01e1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.786656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8511-40f4-4ca6-a0ae-f62d1c01e1ae None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.786938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8511-40f4-4ca6-a0ae-f62d1c01e1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.787215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8511-40f4-4ca6-a0ae-f62d1c01e1ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.787948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf8511-40f4-4ca6-a0ae-f62d1c01e1ae None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=4ee382ab3c8945f1b39b14b00d9237ba) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:26.788260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf8511-40f4-4ca6-a0ae-f62d1c01e1ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:26.789789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf8511-40f4-4ca6-a0ae-f62d1c01e1ae None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:26.795579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 291/572] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/role_assignments?user.id=4ee382ab3c8945f1b39b14b00d9237ba&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:26.796535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf8511-40f4-4ca6-a0ae-f62d1c01e1ae None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:26.867329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:26.894477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07333c87-64d4-4b2a-bea5-488c453a925c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.933292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43d435-509f-427a-acb6-7d42a4b48c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.933954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43d435-509f-427a-acb6-7d42a4b48c13 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.934238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43d435-509f-427a-acb6-7d42a4b48c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.934515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43d435-509f-427a-acb6-7d42a4b48c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.936592 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf8511-40f4-4ca6-a0ae-f62d1c01e1ae None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:26.938377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:26.949275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43d435-509f-427a-acb6-7d42a4b48c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:26.950745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43d435-509f-427a-acb6-7d42a4b48c13 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5b43d435-509f-427a-acb6-7d42a4b48c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:26.968025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:26.969190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:26.970330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:26.970330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:26.970330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:26.970330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 282/573] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:26.970330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569883d5-e8cc-4a52-bae0-ef28ad193cb4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.970685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569883d5-e8cc-4a52-bae0-ef28ad193cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.975512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569883d5-e8cc-4a52-bae0-ef28ad193cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.982807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eb84b-b4a3-4830-81e0-673d4c935cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:26.983431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eb84b-b4a3-4830-81e0-673d4c935cea None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:26.983716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eb84b-b4a3-4830-81e0-673d4c935cea None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:26.983998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eb84b-b4a3-4830-81e0-673d4c935cea None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:26.984714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eb84b-b4a3-4830-81e0-673d4c935cea None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:26.985029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eb84b-b4a3-4830-81e0-673d4c935cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:26.986909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eb84b-b4a3-4830-81e0-673d4c935cea None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:26.990810 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-569883d5-e8cc-4a52-bae0-ef28ad193cb4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:26.991996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-569883d5-e8cc-4a52-bae0-ef28ad193cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:27.000240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 292/574] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:27.000240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eb84b-b4a3-4830-81e0-673d4c935cea None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.073701 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 283/575] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:27.074899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569883d5-e8cc-4a52-bae0-ef28ad193cb4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.124651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eb84b-b4a3-4830-81e0-673d4c935cea None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:27.135864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:27.167002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21d6af-4fb3-4e4d-bc6e-bcb83216af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:27.167627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21d6af-4fb3-4e4d-bc6e-bcb83216af84 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:27.167910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21d6af-4fb3-4e4d-bc6e-bcb83216af84 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:27.168186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21d6af-4fb3-4e4d-bc6e-bcb83216af84 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:27.168882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21d6af-4fb3-4e4d-bc6e-bcb83216af84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:27.169186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21d6af-4fb3-4e4d-bc6e-bcb83216af84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:27.170605 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21d6af-4fb3-4e4d-bc6e-bcb83216af84 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:27.187253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 293/576] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:27.188130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21d6af-4fb3-4e4d-bc6e-bcb83216af84 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.210508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569883d5-e8cc-4a52-bae0-ef28ad193cb4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:27.235308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:27.263554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde21c24-f197-4228-b770-ba9c34d7c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:27.265978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde21c24-f197-4228-b770-ba9c34d7c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:27.267017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde21c24-f197-4228-b770-ba9c34d7c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:27.267536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde21c24-f197-4228-b770-ba9c34d7c8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:27.269227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde21c24-f197-4228-b770-ba9c34d7c8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:27.270073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde21c24-f197-4228-b770-ba9c34d7c8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:27.272385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde21c24-f197-4228-b770-ba9c34d7c8f8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:27.293907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 284/577] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:27.305234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde21c24-f197-4228-b770-ba9c34d7c8f8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.349599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21d6af-4fb3-4e4d-bc6e-bcb83216af84 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:27.391435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76b129-0a64-4f81-b705-5c6bbb4cc098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:27.392111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76b129-0a64-4f81-b705-5c6bbb4cc098 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:27.392393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76b129-0a64-4f81-b705-5c6bbb4cc098 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:27.392747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76b129-0a64-4f81-b705-5c6bbb4cc098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:27.409771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76b129-0a64-4f81-b705-5c6bbb4cc098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:27.411240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76b129-0a64-4f81-b705-5c6bbb4cc098 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8d76b129-0a64-4f81-b705-5c6bbb4cc098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:27.428297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:27.429360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:27.430262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:27.430262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:27.430262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:27.430262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 294/578] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:27.430510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76b129-0a64-4f81-b705-5c6bbb4cc098 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.454741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde21c24-f197-4228-b770-ba9c34d7c8f8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:27.455801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:27.493526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465325-f905-4066-b393-a0007dc088e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:27.494238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465325-f905-4066-b393-a0007dc088e7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:27.494534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465325-f905-4066-b393-a0007dc088e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:27.494804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465325-f905-4066-b393-a0007dc088e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:27.502402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c465325-f905-4066-b393-a0007dc088e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:27.503862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c465325-f905-4066-b393-a0007dc088e7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-3c465325-f905-4066-b393-a0007dc088e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:27.515766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:27.516731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:27.517808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:27.517808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:27.517808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:27.517808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:27.517808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:27.517808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:27.517808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:27.517808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:27.520787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 285/579] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:27.522133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465325-f905-4066-b393-a0007dc088e7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.545103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76b129-0a64-4f81-b705-5c6bbb4cc098 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:27.566174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:27.583744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849bf8-1624-4085-a662-11572a21fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:27.584378 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849bf8-1624-4085-a662-11572a21fca0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:27.584693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849bf8-1624-4085-a662-11572a21fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:27.584974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90849bf8-1624-4085-a662-11572a21fca0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:27.592155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90849bf8-1624-4085-a662-11572a21fca0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:27.593633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90849bf8-1624-4085-a662-11572a21fca0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-90849bf8-1624-4085-a662-11572a21fca0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:27.605754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:27.606906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:27.608116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:27.608116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:27.608116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:27.608116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:27.608116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:27.608116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:27.608116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:27.608116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:27.608116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:51:27.608116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:27.612145 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 295/580] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:27.613020 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849bf8-1624-4085-a662-11572a21fca0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.634509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465325-f905-4066-b393-a0007dc088e7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:27.669178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b5838-a79d-4086-b1cb-6f18e480e04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:27.670240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b5838-a79d-4086-b1cb-6f18e480e04b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:27.670522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b5838-a79d-4086-b1cb-6f18e480e04b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:27.670946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b5838-a79d-4086-b1cb-6f18e480e04b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:27.683206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b5838-a79d-4086-b1cb-6f18e480e04b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-352b5838-a79d-4086-b1cb-6f18e480e04b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:27.691134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:27.692102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:27.693082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:27.696829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 286/581] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:27.697943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b5838-a79d-4086-b1cb-6f18e480e04b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.698756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:27.723079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90849bf8-1624-4085-a662-11572a21fca0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:27.768353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613358d-3fc9-4475-9e87-b72f67a67a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:27.769251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613358d-3fc9-4475-9e87-b72f67a67a03 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:27.769726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613358d-3fc9-4475-9e87-b72f67a67a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:27.770002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613358d-3fc9-4475-9e87-b72f67a67a03 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:27.770657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613358d-3fc9-4475-9e87-b72f67a67a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:27.771244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613358d-3fc9-4475-9e87-b72f67a67a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:27.772350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613358d-3fc9-4475-9e87-b72f67a67a03 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:27.793810 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 296/582] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:27.793810 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613358d-3fc9-4475-9e87-b72f67a67a03 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.808680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:27.816842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b5838-a79d-4086-b1cb-6f18e480e04b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:27.853479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b50899-92af-4e11-a0fe-51295960896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:27.854092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50899-92af-4e11-a0fe-51295960896a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:27.854372 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50899-92af-4e11-a0fe-51295960896a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:27.854643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50899-92af-4e11-a0fe-51295960896a None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:27.855367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b50899-92af-4e11-a0fe-51295960896a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:27.855674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b50899-92af-4e11-a0fe-51295960896a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:27.857139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b50899-92af-4e11-a0fe-51295960896a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:27.880959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 287/583] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:27.881942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b50899-92af-4e11-a0fe-51295960896a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.903701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613358d-3fc9-4475-9e87-b72f67a67a03 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:27.943332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d4066-6430-4f55-8801-09163c2322ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:27.944011 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4066-6430-4f55-8801-09163c2322ad None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:27.944383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4066-6430-4f55-8801-09163c2322ad None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:27.944779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4066-6430-4f55-8801-09163c2322ad None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:27.945602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d4066-6430-4f55-8801-09163c2322ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:27.946163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d4066-6430-4f55-8801-09163c2322ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:27.947626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d4066-6430-4f55-8801-09163c2322ad None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:27.958049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:27.971316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 297/584] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Aug 18 16:51:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:27.971316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d4066-6430-4f55-8801-09163c2322ad None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:27.997205 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b50899-92af-4e11-a0fe-51295960896a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:28.036086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15fc16-7966-4c91-8f79-d0d965a25367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:28.036729 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15fc16-7966-4c91-8f79-d0d965a25367 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.037011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15fc16-7966-4c91-8f79-d0d965a25367 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.037289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15fc16-7966-4c91-8f79-d0d965a25367 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:28.037956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15fc16-7966-4c91-8f79-d0d965a25367 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:28.038264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15fc16-7966-4c91-8f79-d0d965a25367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:28.039626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15fc16-7966-4c91-8f79-d0d965a25367 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:28.052347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 288/585] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:28.052347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15fc16-7966-4c91-8f79-d0d965a25367 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:28.078043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d4066-6430-4f55-8801-09163c2322ad None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:28.078646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:28.115074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393e02b-e0e3-4814-a908-db037a5de381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:28.115706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393e02b-e0e3-4814-a908-db037a5de381 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.115982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393e02b-e0e3-4814-a908-db037a5de381 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.116537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393e02b-e0e3-4814-a908-db037a5de381 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:28.123658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393e02b-e0e3-4814-a908-db037a5de381 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:28.125137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393e02b-e0e3-4814-a908-db037a5de381 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2393e02b-e0e3-4814-a908-db037a5de381 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:28.136910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:28.138086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 298/586] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:28.139048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393e02b-e0e3-4814-a908-db037a5de381 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:28.167960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15fc16-7966-4c91-8f79-d0d965a25367 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:28.204883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836441c-7148-4bb8-a6a8-587bb8373269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:28.205504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836441c-7148-4bb8-a6a8-587bb8373269 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.205787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836441c-7148-4bb8-a6a8-587bb8373269 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.206062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836441c-7148-4bb8-a6a8-587bb8373269 None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/c425b390c8dc4d799270fdd095be78b4/roles/b5bf9002fca54b179a5f07114e18fa07` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:28.208191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:28.223152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836441c-7148-4bb8-a6a8-587bb8373269 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=c425b390c8dc4d799270fdd095be78b4, role_id=b5bf9002fca54b179a5f07114e18fa07)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:28.224616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836441c-7148-4bb8-a6a8-587bb8373269 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:28.238078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 289/587] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:51:28 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/c425b390c8dc4d799270fdd095be78b4/roles/b5bf9002fca54b179a5f07114e18fa07 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:51:28.249454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836441c-7148-4bb8-a6a8-587bb8373269 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:28.265307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393e02b-e0e3-4814-a908-db037a5de381 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:28.321790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fab170-793e-48ff-9691-1c69991ebec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:28.322823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fab170-793e-48ff-9691-1c69991ebec7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.323610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fab170-793e-48ff-9691-1c69991ebec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.324077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fab170-793e-48ff-9691-1c69991ebec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:28.342087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fab170-793e-48ff-9691-1c69991ebec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:28.343573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fab170-793e-48ff-9691-1c69991ebec7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:28.346027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-78fab170-793e-48ff-9691-1c69991ebec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:28.369512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:28.370562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:28.371479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:28.371479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:28.371479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:28.379226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 299/588] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:28.379226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fab170-793e-48ff-9691-1c69991ebec7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:28.393871 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836441c-7148-4bb8-a6a8-587bb8373269 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:28.441321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475039-c3f8-434e-a52f-6ee1bc072cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:28.443003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475039-c3f8-434e-a52f-6ee1bc072cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.443519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475039-c3f8-434e-a52f-6ee1bc072cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.443999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475039-c3f8-434e-a52f-6ee1bc072cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:28.463211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14475039-c3f8-434e-a52f-6ee1bc072cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:28.464609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14475039-c3f8-434e-a52f-6ee1bc072cd8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-14475039-c3f8-434e-a52f-6ee1bc072cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:28.481310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:28.482354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:28.483784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:28.483784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:28.483784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:28.483784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 290/589] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:28.483784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475039-c3f8-434e-a52f-6ee1bc072cd8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:28.521365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fab170-793e-48ff-9691-1c69991ebec7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:28.536997 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:28.572138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68ea9b-f61e-4c8f-a112-a7840dff281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:28.573121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68ea9b-f61e-4c8f-a112-a7840dff281c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.574354 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68ea9b-f61e-4c8f-a112-a7840dff281c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.574888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68ea9b-f61e-4c8f-a112-a7840dff281c None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:28.575948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68ea9b-f61e-4c8f-a112-a7840dff281c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:28.576628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68ea9b-f61e-4c8f-a112-a7840dff281c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:28.578966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68ea9b-f61e-4c8f-a112-a7840dff281c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:28.608872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 300/590] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Aug 18 16:51:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:28.609844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68ea9b-f61e-4c8f-a112-a7840dff281c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:28.622473 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475039-c3f8-434e-a52f-6ee1bc072cd8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:28.647154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:28.660850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b8d2e-32e0-4981-98cf-1a1880ffa7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:28.661581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b8d2e-32e0-4981-98cf-1a1880ffa7db None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.661938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b8d2e-32e0-4981-98cf-1a1880ffa7db None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.662285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b8d2e-32e0-4981-98cf-1a1880ffa7db None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:28.663085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b8d2e-32e0-4981-98cf-1a1880ffa7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:28.663479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b8d2e-32e0-4981-98cf-1a1880ffa7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:28.665099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b8d2e-32e0-4981-98cf-1a1880ffa7db None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:28.679452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 291/591] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:28.680425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b8d2e-32e0-4981-98cf-1a1880ffa7db None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:28.732739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68ea9b-f61e-4c8f-a112-a7840dff281c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:28.772612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee92d1-36ef-4f0f-8980-fecb900d0331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:28.773339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee92d1-36ef-4f0f-8980-fecb900d0331 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.773696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee92d1-36ef-4f0f-8980-fecb900d0331 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.774063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee92d1-36ef-4f0f-8980-fecb900d0331 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:28.774795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee92d1-36ef-4f0f-8980-fecb900d0331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:28.775169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee92d1-36ef-4f0f-8980-fecb900d0331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:28.776774 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee92d1-36ef-4f0f-8980-fecb900d0331 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:28.790662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 301/592] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:28.791529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee92d1-36ef-4f0f-8980-fecb900d0331 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:28.807394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b8d2e-32e0-4981-98cf-1a1880ffa7db None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:28.838236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:28.858029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fab581-bf04-4d5d-bcb6-3250cd9640e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:28.859159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fab581-bf04-4d5d-bcb6-3250cd9640e8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.859159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fab581-bf04-4d5d-bcb6-3250cd9640e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.859455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fab581-bf04-4d5d-bcb6-3250cd9640e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:28.872142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fab581-bf04-4d5d-bcb6-3250cd9640e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:28.873642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fab581-bf04-4d5d-bcb6-3250cd9640e8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a5fab581-bf04-4d5d-bcb6-3250cd9640e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:28.890805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:28.892139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:28.893691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:28.893691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:28.893691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:28.896629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 292/593] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:28.898681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bab0a7-f84b-4479-b49e-ccd6423139ac None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.899153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bab0a7-f84b-4479-b49e-ccd6423139ac None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.899434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bab0a7-f84b-4479-b49e-ccd6423139ac None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:28.901033 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 293/594] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:28.901583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bab0a7-f84b-4479-b49e-ccd6423139ac None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:28.943571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:28.955801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee92d1-36ef-4f0f-8980-fecb900d0331 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:28.995342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb9ad3-88e6-4600-9ba7-e00c7ccf1579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:28.995901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb9ad3-88e6-4600-9ba7-e00c7ccf1579 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:28.996180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb9ad3-88e6-4600-9ba7-e00c7ccf1579 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:28.996452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb9ad3-88e6-4600-9ba7-e00c7ccf1579 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.004189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb9ad3-88e6-4600-9ba7-e00c7ccf1579 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:29.005692 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb9ad3-88e6-4600-9ba7-e00c7ccf1579 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-42fb9ad3-88e6-4600-9ba7-e00c7ccf1579 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:29.017204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:29.018349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:29.019410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:29.019410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:29.019410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:29.019410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:29.019410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:29.019410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:29.019410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:29.019410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:29.019410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 302/595] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:29.019410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb9ad3-88e6-4600-9ba7-e00c7ccf1579 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:29.034159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bab0a7-f84b-4479-b49e-ccd6423139ac None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:29.081400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66611467-6dec-401e-a960-65e06dd7a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:29.082044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66611467-6dec-401e-a960-65e06dd7a7ed None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.082329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66611467-6dec-401e-a960-65e06dd7a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.082605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66611467-6dec-401e-a960-65e06dd7a7ed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.090268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66611467-6dec-401e-a960-65e06dd7a7ed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:29.091722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66611467-6dec-401e-a960-65e06dd7a7ed None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-66611467-6dec-401e-a960-65e06dd7a7ed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:29.103954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:29.105002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:29.105986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 294/596] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:29.106615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aeaa5-2d1c-4896-a5b2-7016bdd2bf3c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.106615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aeaa5-2d1c-4896-a5b2-7016bdd2bf3c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.106742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aeaa5-2d1c-4896-a5b2-7016bdd2bf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.125241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7f6aeaa5-2d1c-4896-a5b2-7016bdd2bf3c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:29.126450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7f6aeaa5-2d1c-4896-a5b2-7016bdd2bf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:29.136087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:29.150916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb9ad3-88e6-4600-9ba7-e00c7ccf1579 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:29.186712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4388c-5a63-4a56-b19f-03b7756d142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:29.187330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4388c-5a63-4a56-b19f-03b7756d142a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.187615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4388c-5a63-4a56-b19f-03b7756d142a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.187898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4388c-5a63-4a56-b19f-03b7756d142a None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.189041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4388c-5a63-4a56-b19f-03b7756d142a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:29.189361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4388c-5a63-4a56-b19f-03b7756d142a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:29.190758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4388c-5a63-4a56-b19f-03b7756d142a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:29.202249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 295/597] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:29.207322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 303/598] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:29.207322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4388c-5a63-4a56-b19f-03b7756d142a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:29.208150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aeaa5-2d1c-4896-a5b2-7016bdd2bf3c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:29.234671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:29.320293 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aeaa5-2d1c-4896-a5b2-7016bdd2bf3c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:29.323722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4388c-5a63-4a56-b19f-03b7756d142a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:29.361506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8564d-0e72-4852-a546-c306a16f20fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:29.362104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8564d-0e72-4852-a546-c306a16f20fd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.362389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8564d-0e72-4852-a546-c306a16f20fd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.362666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8564d-0e72-4852-a546-c306a16f20fd None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.363398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8564d-0e72-4852-a546-c306a16f20fd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:29.363709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8564d-0e72-4852-a546-c306a16f20fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:29.365417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8564d-0e72-4852-a546-c306a16f20fd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:29.368902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a582c-87c3-4c14-8d1c-d57bad4fc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:29.369783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a582c-87c3-4c14-8d1c-d57bad4fc343 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.370229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a582c-87c3-4c14-8d1c-d57bad4fc343 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.370700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a582c-87c3-4c14-8d1c-d57bad4fc343 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.371644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a582c-87c3-4c14-8d1c-d57bad4fc343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:29.372098 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a582c-87c3-4c14-8d1c-d57bad4fc343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:29.373853 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a582c-87c3-4c14-8d1c-d57bad4fc343 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:29.383638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 304/599] 10.222.0.81 () {56 vars in 1139 bytes} [Thu Aug 18 16:51:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:29.384195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8564d-0e72-4852-a546-c306a16f20fd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:29.392190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 296/600] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:29.393106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:29.394584 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a582c-87c3-4c14-8d1c-d57bad4fc343 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:29.492333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:29.500367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8564d-0e72-4852-a546-c306a16f20fd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:29.514185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a582c-87c3-4c14-8d1c-d57bad4fc343 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:29.536210 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81bdd-306b-443c-b151-ff7770c7ddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:29.536880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81bdd-306b-443c-b151-ff7770c7ddb1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.537168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81bdd-306b-443c-b151-ff7770c7ddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.537453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81bdd-306b-443c-b151-ff7770c7ddb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.544305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b81bdd-306b-443c-b151-ff7770c7ddb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:29.545875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b81bdd-306b-443c-b151-ff7770c7ddb1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:29.551296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049151-f67e-4569-9c64-58e9e418623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:29.552134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049151-f67e-4569-9c64-58e9e418623e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.552600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049151-f67e-4569-9c64-58e9e418623e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.553019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049151-f67e-4569-9c64-58e9e418623e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e2b81bdd-306b-443c-b151-ff7770c7ddb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:29.557787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:29.558851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:29.559917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:29.559917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:29.559917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:29.559917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:29.559917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:29.559917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:29.559917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:29.559917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:29.559917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 305/601] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:29.559917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81bdd-306b-443c-b151-ff7770c7ddb1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:29.567702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10049151-f67e-4569-9c64-58e9e418623e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:29.569390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10049151-f67e-4569-9c64-58e9e418623e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-10049151-f67e-4569-9c64-58e9e418623e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:29.584822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:29.585931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:29.587029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:29.587029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:29.587029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:29.588410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 297/602] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:29.589352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049151-f67e-4569-9c64-58e9e418623e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:29.640141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:29.680576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81bdd-306b-443c-b151-ff7770c7ddb1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:29.700344 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049151-f67e-4569-9c64-58e9e418623e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:29.724862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb82b3-037e-4fb8-9b66-6f50408f6007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:29.725561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb82b3-037e-4fb8-9b66-6f50408f6007 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.725840 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb82b3-037e-4fb8-9b66-6f50408f6007 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.726115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb82b3-037e-4fb8-9b66-6f50408f6007 None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/a710cfeadd004a8bbf932f6bb3b211e5/roles/b5bf9002fca54b179a5f07114e18fa07` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.742979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb82b3-037e-4fb8-9b66-6f50408f6007 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=a710cfeadd004a8bbf932f6bb3b211e5, role_id=b5bf9002fca54b179a5f07114e18fa07)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:29.743832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3e1c4-c8d6-4a55-81bb-9eb3b55d0dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:29.744433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb82b3-037e-4fb8-9b66-6f50408f6007 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:29.744943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3e1c4-c8d6-4a55-81bb-9eb3b55d0dce None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.745178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3e1c4-c8d6-4a55-81bb-9eb3b55d0dce None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.745465 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3e1c4-c8d6-4a55-81bb-9eb3b55d0dce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.749238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:29.768488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 306/603] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:51:29 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/a710cfeadd004a8bbf932f6bb3b211e5/roles/b5bf9002fca54b179a5f07114e18fa07 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:51:29.768694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3e1c4-c8d6-4a55-81bb-9eb3b55d0dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:29.768777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb82b3-037e-4fb8-9b66-6f50408f6007 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-dcd3e1c4-c8d6-4a55-81bb-9eb3b55d0dce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:29.768879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:29.769766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 298/604] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:29.770615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3e1c4-c8d6-4a55-81bb-9eb3b55d0dce None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:29.905479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb82b3-037e-4fb8-9b66-6f50408f6007 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:29.908766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3e1c4-c8d6-4a55-81bb-9eb3b55d0dce None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:29.926904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:29.951926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2a6b4-25a5-4569-abd5-94584361dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:29.952602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2a6b4-25a5-4569-abd5-94584361dee7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.952888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2a6b4-25a5-4569-abd5-94584361dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.953165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2a6b4-25a5-4569-abd5-94584361dee7 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.954010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2a6b4-25a5-4569-abd5-94584361dee7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:29.954484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2a6b4-25a5-4569-abd5-94584361dee7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:29.956018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2a6b4-25a5-4569-abd5-94584361dee7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:29.960006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72364-681e-43c2-8aa2-6c50b7516e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:29.960891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72364-681e-43c2-8aa2-6c50b7516e93 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:29.961347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72364-681e-43c2-8aa2-6c50b7516e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:29.961773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72364-681e-43c2-8aa2-6c50b7516e93 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:29.962585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc72364-681e-43c2-8aa2-6c50b7516e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:29.962896 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc72364-681e-43c2-8aa2-6c50b7516e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:29.964274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc72364-681e-43c2-8aa2-6c50b7516e93 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:29.969426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 307/605] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:29.970819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2a6b4-25a5-4569-abd5-94584361dee7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:29.982590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 299/606] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:29.982590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72364-681e-43c2-8aa2-6c50b7516e93 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:30.048886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:30.103415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72364-681e-43c2-8aa2-6c50b7516e93 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:30.114262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2a6b4-25a5-4569-abd5-94584361dee7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:30.150156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61318-07ea-408e-83fc-842d9579660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:30.151192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61318-07ea-408e-83fc-842d9579660c None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:30.151572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61318-07ea-408e-83fc-842d9579660c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:30.152213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc61318-07ea-408e-83fc-842d9579660c None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/2aa331983fbc4b18b7880084adcba3c5/roles/b5bf9002fca54b179a5f07114e18fa07` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:30.158245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e084c8-173d-4823-8421-6931ddb0372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:30.159444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e084c8-173d-4823-8421-6931ddb0372b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:30.159874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e084c8-173d-4823-8421-6931ddb0372b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:30.160297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e084c8-173d-4823-8421-6931ddb0372b None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:30.161229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e084c8-173d-4823-8421-6931ddb0372b None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:30.161684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e084c8-173d-4823-8421-6931ddb0372b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:30.163315 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e084c8-173d-4823-8421-6931ddb0372b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:30.170398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc61318-07ea-408e-83fc-842d9579660c None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=2aa331983fbc4b18b7880084adcba3c5, role_id=b5bf9002fca54b179a5f07114e18fa07)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:30.172222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc61318-07ea-408e-83fc-842d9579660c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:30.173740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 308/607] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:30.174775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e084c8-173d-4823-8421-6931ddb0372b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:30.197913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 300/608] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:51:29 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/2aa331983fbc4b18b7880084adcba3c5/roles/b5bf9002fca54b179a5f07114e18fa07 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:51:30.201525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61318-07ea-408e-83fc-842d9579660c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:30.256495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:30.344150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e084c8-173d-4823-8421-6931ddb0372b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:30.371160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc61318-07ea-408e-83fc-842d9579660c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:30.385549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:30.395563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509e2d6-c891-4e95-87a0-af05bd932ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:30.396639 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e2d6-c891-4e95-87a0-af05bd932ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:30.396935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e2d6-c891-4e95-87a0-af05bd932ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:30.397217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e2d6-c891-4e95-87a0-af05bd932ad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:30.404438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509e2d6-c891-4e95-87a0-af05bd932ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:30.405907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509e2d6-c891-4e95-87a0-af05bd932ad5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3509e2d6-c891-4e95-87a0-af05bd932ad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:30.420550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:30.421609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:30.422528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:30.422528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:30.422528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:30.422528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:30.422528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:30.422528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:30.422528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:30.422528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:30.422528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 309/609] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:30.423217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12f89a-b465-434f-a848-2f87d8ad8180 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:30.423506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12f89a-b465-434f-a848-2f87d8ad8180 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:30.423757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c734303-5983-49a3-b4d0-e220c46ed5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:30.423871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12f89a-b465-434f-a848-2f87d8ad8180 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:30.424666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c734303-5983-49a3-b4d0-e220c46ed5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:30.425077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c734303-5983-49a3-b4d0-e220c46ed5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:30.425304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 310/610] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:30.425641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c734303-5983-49a3-b4d0-e220c46ed5f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:30.430869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12f89a-b465-434f-a848-2f87d8ad8180 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:30.445704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c734303-5983-49a3-b4d0-e220c46ed5f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:30.447384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c734303-5983-49a3-b4d0-e220c46ed5f2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5c734303-5983-49a3-b4d0-e220c46ed5f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:30.463613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:30.464782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:30.465966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:30.465966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:30.465966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:30.467943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 301/611] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:30.469542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ada4e-6324-4929-84be-e1df6005f44c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:30.470659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ada4e-6324-4929-84be-e1df6005f44c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:30.471121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ada4e-6324-4929-84be-e1df6005f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:30.490166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-435ada4e-6324-4929-84be-e1df6005f44c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:30.491741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-435ada4e-6324-4929-84be-e1df6005f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:30.551770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:30.557380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12f89a-b465-434f-a848-2f87d8ad8180 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:30.589553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 302/612] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:30.590674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ada4e-6324-4929-84be-e1df6005f44c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:30.606769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fe8cf-b709-4146-be72-9c686774b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:30.607595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fe8cf-b709-4146-be72-9c686774b3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:30.607973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fe8cf-b709-4146-be72-9c686774b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:30.608397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fe8cf-b709-4146-be72-9c686774b3a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:30.609222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fe8cf-b709-4146-be72-9c686774b3a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:30.609735 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fe8cf-b709-4146-be72-9c686774b3a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:30.616773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fe8cf-b709-4146-be72-9c686774b3a9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:30.642804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 311/613] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:30.648743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fe8cf-b709-4146-be72-9c686774b3a9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:30.697581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:30.714275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ada4e-6324-4929-84be-e1df6005f44c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:30.785743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1306-9596-4fdb-b173-e677c22b60ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:30.786592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1306-9596-4fdb-b173-e677c22b60ab None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:30.786878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1306-9596-4fdb-b173-e677c22b60ab None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:30.787157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc1306-9596-4fdb-b173-e677c22b60ab None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:30.788610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc1306-9596-4fdb-b173-e677c22b60ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:30.788937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc1306-9596-4fdb-b173-e677c22b60ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:30.790992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc1306-9596-4fdb-b173-e677c22b60ab None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:30.817912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 303/614] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:30.824238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1306-9596-4fdb-b173-e677c22b60ab None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:30.863170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fe8cf-b709-4146-be72-9c686774b3a9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:30.898443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32bb75-d07b-4699-a8d6-fce0bc99a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:30.899201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32bb75-d07b-4699-a8d6-fce0bc99a329 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:30.899483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32bb75-d07b-4699-a8d6-fce0bc99a329 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:30.899761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32bb75-d07b-4699-a8d6-fce0bc99a329 None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/7b1fde904acd460899d8c736f5762056/roles/b5bf9002fca54b179a5f07114e18fa07` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:30.917924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32bb75-d07b-4699-a8d6-fce0bc99a329 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=7b1fde904acd460899d8c736f5762056, role_id=b5bf9002fca54b179a5f07114e18fa07)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:30.919599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32bb75-d07b-4699-a8d6-fce0bc99a329 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:30.938974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 312/615] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:51:30 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/7b1fde904acd460899d8c736f5762056/roles/b5bf9002fca54b179a5f07114e18fa07 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:51:31.028772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32bb75-d07b-4699-a8d6-fce0bc99a329 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:31.046601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:31.050919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc1306-9596-4fdb-b173-e677c22b60ab None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:31.113257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eace038-e1b0-446d-847b-a6a64bc2aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:31.113922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eace038-e1b0-446d-847b-a6a64bc2aab3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:31.114201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eace038-e1b0-446d-847b-a6a64bc2aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:31.114475 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eace038-e1b0-446d-847b-a6a64bc2aab3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:31.129783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eace038-e1b0-446d-847b-a6a64bc2aab3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:31.131284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eace038-e1b0-446d-847b-a6a64bc2aab3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0eace038-e1b0-446d-847b-a6a64bc2aab3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:31.156968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:31.158085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:31.159062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:31.159062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:31.159062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:31.159062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:31.159062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:31.159062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:31.159062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:31.159062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:31.159062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:31.159062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:31.161608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 304/616] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:31.176369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32bb75-d07b-4699-a8d6-fce0bc99a329 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:31.178063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eace038-e1b0-446d-847b-a6a64bc2aab3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:31.191303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:31.218332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b245-026b-409d-9dbf-588740f7c108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:31.218993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b245-026b-409d-9dbf-588740f7c108 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:31.219280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b245-026b-409d-9dbf-588740f7c108 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:31.219620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b245-026b-409d-9dbf-588740f7c108 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:31.231134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b245-026b-409d-9dbf-588740f7c108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-58e6b245-026b-409d-9dbf-588740f7c108 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:31.236710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:31.237705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:31.238576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 313/617] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:31.246091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b245-026b-409d-9dbf-588740f7c108 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:31.308502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eace038-e1b0-446d-847b-a6a64bc2aab3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:31.350450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81d25-ebe7-4f82-9b6b-3412df6245c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:31.351079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81d25-ebe7-4f82-9b6b-3412df6245c5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:31.351357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81d25-ebe7-4f82-9b6b-3412df6245c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:31.351633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81d25-ebe7-4f82-9b6b-3412df6245c5 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:31.352619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c81d25-ebe7-4f82-9b6b-3412df6245c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:31.352962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c81d25-ebe7-4f82-9b6b-3412df6245c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:31.354626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c81d25-ebe7-4f82-9b6b-3412df6245c5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:31.375858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 305/618] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Aug 18 16:51:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:31.381322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81d25-ebe7-4f82-9b6b-3412df6245c5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:31.393506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:31.438813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b245-026b-409d-9dbf-588740f7c108 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:31.509602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96743a-2a18-4787-9a35-fb2022b24beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:31.510583 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96743a-2a18-4787-9a35-fb2022b24beb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:31.511095 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96743a-2a18-4787-9a35-fb2022b24beb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:31.511573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96743a-2a18-4787-9a35-fb2022b24beb None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:31.512484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96743a-2a18-4787-9a35-fb2022b24beb None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:31.512995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96743a-2a18-4787-9a35-fb2022b24beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:31.516168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96743a-2a18-4787-9a35-fb2022b24beb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:31.539454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 314/619] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:31.548931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:31.550239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96743a-2a18-4787-9a35-fb2022b24beb None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:31.613735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81d25-ebe7-4f82-9b6b-3412df6245c5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:31.681103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e953-3217-40a4-968a-3f332ccbb53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:31.681871 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e953-3217-40a4-968a-3f332ccbb53d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:31.682161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e953-3217-40a4-968a-3f332ccbb53d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:31.682438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e953-3217-40a4-968a-3f332ccbb53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:31.690467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96743a-2a18-4787-9a35-fb2022b24beb None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:31.706158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5e953-3217-40a4-968a-3f332ccbb53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:31.707780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5e953-3217-40a4-968a-3f332ccbb53d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:31.728304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-66f5e953-3217-40a4-968a-3f332ccbb53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:31.732563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:31.733697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:31.734644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:31.734644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:31.734644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:31.734644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 306/620] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:31.741321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e953-3217-40a4-968a-3f332ccbb53d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:31.742126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f70cc-de9b-45ab-8f82-ae7c02f8bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:31.742782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f70cc-de9b-45ab-8f82-ae7c02f8bb03 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:31.743062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f70cc-de9b-45ab-8f82-ae7c02f8bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:31.743337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f70cc-de9b-45ab-8f82-ae7c02f8bb03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:31.755291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f70cc-de9b-45ab-8f82-ae7c02f8bb03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:31.756807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f70cc-de9b-45ab-8f82-ae7c02f8bb03 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-335f70cc-de9b-45ab-8f82-ae7c02f8bb03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:31.775126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:31.777157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:31.778274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:31.778274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:31.778274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:31.778274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 315/621] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:31.785479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f70cc-de9b-45ab-8f82-ae7c02f8bb03 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:31.933655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e953-3217-40a4-968a-3f332ccbb53d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:31.968764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:31.980770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06007af-8207-4716-95ba-223322b5a23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:31.981407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06007af-8207-4716-95ba-223322b5a23d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:31.981698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06007af-8207-4716-95ba-223322b5a23d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:31.981983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06007af-8207-4716-95ba-223322b5a23d None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:31.982649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06007af-8207-4716-95ba-223322b5a23d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:31.982965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06007af-8207-4716-95ba-223322b5a23d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:31.984361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06007af-8207-4716-95ba-223322b5a23d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:31.996804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f70cc-de9b-45ab-8f82-ae7c02f8bb03 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:32.014585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 307/622] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:32.021017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06007af-8207-4716-95ba-223322b5a23d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:32.034760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a5ae7-795a-4c0b-b678-9f0483bc8a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:32.035645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5ae7-795a-4c0b-b678-9f0483bc8a1c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.035940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5ae7-795a-4c0b-b678-9f0483bc8a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.036224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5ae7-795a-4c0b-b678-9f0483bc8a1c None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.036998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a5ae7-795a-4c0b-b678-9f0483bc8a1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:32.037311 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a5ae7-795a-4c0b-b678-9f0483bc8a1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:32.038799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a5ae7-795a-4c0b-b678-9f0483bc8a1c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:32.052521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 316/623] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:32.063303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a5ae7-795a-4c0b-b678-9f0483bc8a1c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:32.134910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:32.190057 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06007af-8207-4716-95ba-223322b5a23d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:32.206320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a5ae7-795a-4c0b-b678-9f0483bc8a1c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:32.226692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250b8e3-ee73-486f-b3b3-db2a8c618235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:32.227346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250b8e3-ee73-486f-b3b3-db2a8c618235 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.227632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250b8e3-ee73-486f-b3b3-db2a8c618235 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.227904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250b8e3-ee73-486f-b3b3-db2a8c618235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.236327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250b8e3-ee73-486f-b3b3-db2a8c618235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:32.237822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250b8e3-ee73-486f-b3b3-db2a8c618235 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:32.245420 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204572c6-25b5-4b85-a170-b0e6ea7799b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:32.246072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204572c6-25b5-4b85-a170-b0e6ea7799b2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.246365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204572c6-25b5-4b85-a170-b0e6ea7799b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.246824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204572c6-25b5-4b85-a170-b0e6ea7799b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c250b8e3-ee73-486f-b3b3-db2a8c618235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:32.250575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:32.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 308/624] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1e2ff-49e5-477e-aa45-41bbe9d69f0d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.257368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1e2ff-49e5-477e-aa45-41bbe9d69f0d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.267550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1e2ff-49e5-477e-aa45-41bbe9d69f0d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.267830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204572c6-25b5-4b85-a170-b0e6ea7799b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:32.268083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 309/625] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:32.268352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204572c6-25b5-4b85-a170-b0e6ea7799b2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:32.268632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2901f9-81e9-40fb-8f1e-7335507a7b4b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.268632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2901f9-81e9-40fb-8f1e-7335507a7b4b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.268632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2901f9-81e9-40fb-8f1e-7335507a7b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-204572c6-25b5-4b85-a170-b0e6ea7799b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:32.272530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:32.276089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 317/626] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Aug 18 16:51:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:32.290302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204572c6-25b5-4b85-a170-b0e6ea7799b2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:32.292808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ae2901f9-81e9-40fb-8f1e-7335507a7b4b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:32.292808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ae2901f9-81e9-40fb-8f1e-7335507a7b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:32.321788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:32.365894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 310/627] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:32.366933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2901f9-81e9-40fb-8f1e-7335507a7b4b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:32.386343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204572c6-25b5-4b85-a170-b0e6ea7799b2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:32.412922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:32.429429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04cb4d-a733-41f4-9e74-5fa7d085f6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:32.430074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04cb4d-a733-41f4-9e74-5fa7d085f6ab None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.430360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04cb4d-a733-41f4-9e74-5fa7d085f6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.430665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04cb4d-a733-41f4-9e74-5fa7d085f6ab None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.431546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04cb4d-a733-41f4-9e74-5fa7d085f6ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:32.431956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04cb4d-a733-41f4-9e74-5fa7d085f6ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:32.433470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04cb4d-a733-41f4-9e74-5fa7d085f6ab None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:32.467620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 318/628] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:32.473624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04cb4d-a733-41f4-9e74-5fa7d085f6ab None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:32.484758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2901f9-81e9-40fb-8f1e-7335507a7b4b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:32.527932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f27b6-f1df-4708-9936-64f23786cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:32.528764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f27b6-f1df-4708-9936-64f23786cfff None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.529299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f27b6-f1df-4708-9936-64f23786cfff None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.529734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f27b6-f1df-4708-9936-64f23786cfff None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.531233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f27b6-f1df-4708-9936-64f23786cfff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:32.531724 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f27b6-f1df-4708-9936-64f23786cfff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:32.533817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f27b6-f1df-4708-9936-64f23786cfff None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:32.556886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 311/629] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Aug 18 16:51:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:32.562835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ce33-e7fd-482f-b754-fba3f64f7b58 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.563245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ce33-e7fd-482f-b754-fba3f64f7b58 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.563604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ce33-e7fd-482f-b754-fba3f64f7b58 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.565264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 312/630] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:32.565979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2ce33-e7fd-482f-b754-fba3f64f7b58 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:32.596050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:32.628356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04cb4d-a733-41f4-9e74-5fa7d085f6ab None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:32.673191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bd472-f6fb-4755-accb-7410b16efb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:32.673865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bd472-f6fb-4755-accb-7410b16efb42 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.674520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bd472-f6fb-4755-accb-7410b16efb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.674803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bd472-f6fb-4755-accb-7410b16efb42 None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/4ee382ab3c8945f1b39b14b00d9237ba/roles/b5bf9002fca54b179a5f07114e18fa07` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.693992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bd472-f6fb-4755-accb-7410b16efb42 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=4ee382ab3c8945f1b39b14b00d9237ba, role_id=b5bf9002fca54b179a5f07114e18fa07)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:32.695451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bd472-f6fb-4755-accb-7410b16efb42 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:32.704040 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2ce33-e7fd-482f-b754-fba3f64f7b58 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:32.712251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 319/631] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:51:32 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/4ee382ab3c8945f1b39b14b00d9237ba/roles/b5bf9002fca54b179a5f07114e18fa07 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:51:32.712780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e44c6-7fb6-4065-a94a-6c615f4e84e3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.712961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e44c6-7fb6-4065-a94a-6c615f4e84e3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.713229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e44c6-7fb6-4065-a94a-6c615f4e84e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.737620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b42e44c6-7fb6-4065-a94a-6c615f4e84e3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:32.741278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b42e44c6-7fb6-4065-a94a-6c615f4e84e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:32.756135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:32.758143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b8426-11d3-47a0-a274-2d462219ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:32.758938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b8426-11d3-47a0-a274-2d462219ab46 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:32.759278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b8426-11d3-47a0-a274-2d462219ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:32.759559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b8426-11d3-47a0-a274-2d462219ab46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:32.854869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 320/632] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:32.856521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e44c6-7fb6-4065-a94a-6c615f4e84e3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:32.856639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b8426-11d3-47a0-a274-2d462219ab46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:32.858258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b8426-11d3-47a0-a274-2d462219ab46 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:32.902343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:32.997736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e44c6-7fb6-4065-a94a-6c615f4e84e3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:32.998114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 313/633] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:33.003748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b8426-11d3-47a0-a274-2d462219ab46 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:33.043636 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1b8d3-67e5-4f56-8f10-69fad3be3d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:33.044660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1b8d3-67e5-4f56-8f10-69fad3be3d1e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:33.045127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1b8d3-67e5-4f56-8f10-69fad3be3d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:33.045585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1b8d3-67e5-4f56-8f10-69fad3be3d1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:33.069257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1b8d3-67e5-4f56-8f10-69fad3be3d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-24b1b8d3-67e5-4f56-8f10-69fad3be3d1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:33.074111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:33.075063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:33.075918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 321/634] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:33.093530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1b8d3-67e5-4f56-8f10-69fad3be3d1e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:33.099736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:33.124256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b8426-11d3-47a0-a274-2d462219ab46 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:33.154358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:33.165506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0e016-678e-4908-ba7e-99c151ad38cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:33.166166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0e016-678e-4908-ba7e-99c151ad38cc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:33.166451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0e016-678e-4908-ba7e-99c151ad38cc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:33.166730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0e016-678e-4908-ba7e-99c151ad38cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:33.179343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0e016-678e-4908-ba7e-99c151ad38cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:33.180984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0e016-678e-4908-ba7e-99c151ad38cc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-37f0e016-678e-4908-ba7e-99c151ad38cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:33.197387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:33.198868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:33.199768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:33.199768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:33.199768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:33.199768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 314/635] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:33.205101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0e016-678e-4908-ba7e-99c151ad38cc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:33.309284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1b8d3-67e5-4f56-8f10-69fad3be3d1e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:33.320992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0e016-678e-4908-ba7e-99c151ad38cc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:33.350081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdba9f1-71c0-4a32-a9dd-643bebdf86e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:33.351045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdba9f1-71c0-4a32-a9dd-643bebdf86e7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:33.351478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdba9f1-71c0-4a32-a9dd-643bebdf86e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:33.351908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdba9f1-71c0-4a32-a9dd-643bebdf86e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:33.352941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdba9f1-71c0-4a32-a9dd-643bebdf86e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:33.353501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdba9f1-71c0-4a32-a9dd-643bebdf86e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:33.355323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdba9f1-71c0-4a32-a9dd-643bebdf86e7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:33.358281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504375d-f760-496e-bf79-ea70d6035a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:33.358914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504375d-f760-496e-bf79-ea70d6035a33 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:33.359198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504375d-f760-496e-bf79-ea70d6035a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:33.359479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504375d-f760-496e-bf79-ea70d6035a33 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:33.360151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504375d-f760-496e-bf79-ea70d6035a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:33.361033 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504375d-f760-496e-bf79-ea70d6035a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:33.362429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504375d-f760-496e-bf79-ea70d6035a33 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:33.368163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 322/636] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:33.369429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdba9f1-71c0-4a32-a9dd-643bebdf86e7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:33.382294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 315/637] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:33.385103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504375d-f760-496e-bf79-ea70d6035a33 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:33.445740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:33.467832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:33.523646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdba9f1-71c0-4a32-a9dd-643bebdf86e7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:33.537992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504375d-f760-496e-bf79-ea70d6035a33 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:33.585303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18004ec-3d06-4406-9a9e-9e7d9343481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:33.585869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18004ec-3d06-4406-9a9e-9e7d9343481b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:33.586150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18004ec-3d06-4406-9a9e-9e7d9343481b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:33.586314 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e34d0b-e92b-4534-b0b8-8747d8039c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:33.586426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18004ec-3d06-4406-9a9e-9e7d9343481b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:33.587130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e34d0b-e92b-4534-b0b8-8747d8039c0b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:33.587491 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e34d0b-e92b-4534-b0b8-8747d8039c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:33.587773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e34d0b-e92b-4534-b0b8-8747d8039c0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:33.599477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18004ec-3d06-4406-9a9e-9e7d9343481b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:33.600965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18004ec-3d06-4406-9a9e-9e7d9343481b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:33.604977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e34d0b-e92b-4534-b0b8-8747d8039c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-96e34d0b-e92b-4534-b0b8-8747d8039c0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:33.610277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:33.611906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:33.612831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:33.616636 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 323/638] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:33.617880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e34d0b-e92b-4534-b0b8-8747d8039c0b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e18004ec-3d06-4406-9a9e-9e7d9343481b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:33.625340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:33.626560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:33.627549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:33.627549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:33.627549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:33.628330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 316/639] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:33.630076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8b4c-9767-47b1-b479-bd2a8f5ffaed None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:33.630601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8b4c-9767-47b1-b479-bd2a8f5ffaed None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:33.631076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8b4c-9767-47b1-b479-bd2a8f5ffaed None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:33.633149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 317/640] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:33.634220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8b4c-9767-47b1-b479-bd2a8f5ffaed None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:33.753298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e34d0b-e92b-4534-b0b8-8747d8039c0b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:33.757214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:33.771772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8b4c-9767-47b1-b479-bd2a8f5ffaed None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:33.780930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:33.794624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd58b92-a8e5-438b-8199-a3f2fc0bcdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:33.795264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd58b92-a8e5-438b-8199-a3f2fc0bcdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:33.795549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd58b92-a8e5-438b-8199-a3f2fc0bcdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:33.795820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd58b92-a8e5-438b-8199-a3f2fc0bcdf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:33.803763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd58b92-a8e5-438b-8199-a3f2fc0bcdf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:33.805279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd58b92-a8e5-438b-8199-a3f2fc0bcdf3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:33.816198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c10a2-2f60-4c0b-8503-9c8f0a5beef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:33.816839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c10a2-2f60-4c0b-8503-9c8f0a5beef4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:33.817118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c10a2-2f60-4c0b-8503-9c8f0a5beef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ebd58b92-a8e5-438b-8199-a3f2fc0bcdf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:33.817219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:33.818362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:33.819382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:33.819382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:33.819382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:33.819382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:33.819382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:33.819382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:33.819382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:33.819382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:33.819840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c10a2-2f60-4c0b-8503-9c8f0a5beef4 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:33.819840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c10a2-2f60-4c0b-8503-9c8f0a5beef4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:33.819840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c10a2-2f60-4c0b-8503-9c8f0a5beef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:33.820036 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 324/641] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:33.820036 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd58b92-a8e5-438b-8199-a3f2fc0bcdf3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:33.820163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c10a2-2f60-4c0b-8503-9c8f0a5beef4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:33.836307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 318/642] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:33.836307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54470587-4998-4ba1-86ce-ccf5a0a51a09 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:33.836307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54470587-4998-4ba1-86ce-ccf5a0a51a09 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:33.836307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54470587-4998-4ba1-86ce-ccf5a0a51a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:33.853961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-54470587-4998-4ba1-86ce-ccf5a0a51a09 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:33.855170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-54470587-4998-4ba1-86ce-ccf5a0a51a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:33.942298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 319/643] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:33.943183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54470587-4998-4ba1-86ce-ccf5a0a51a09 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:33.953496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd58b92-a8e5-438b-8199-a3f2fc0bcdf3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:34.021924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1a17-96b2-4db7-8407-b9dfcaaac5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:34.023134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1a17-96b2-4db7-8407-b9dfcaaac5fc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.023653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1a17-96b2-4db7-8407-b9dfcaaac5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.024162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1a17-96b2-4db7-8407-b9dfcaaac5fc None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.025578 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a1a17-96b2-4db7-8407-b9dfcaaac5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:34.026144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a1a17-96b2-4db7-8407-b9dfcaaac5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:34.029178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a1a17-96b2-4db7-8407-b9dfcaaac5fc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:34.040699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:34.058112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 325/644] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:34.059249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1a17-96b2-4db7-8407-b9dfcaaac5fc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:34.066822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54470587-4998-4ba1-86ce-ccf5a0a51a09 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:34.107960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2fa5e-6057-4405-a888-a3cb59c96a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:34.108525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2fa5e-6057-4405-a888-a3cb59c96a6f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.108811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2fa5e-6057-4405-a888-a3cb59c96a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.109089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2fa5e-6057-4405-a888-a3cb59c96a6f None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.109989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2fa5e-6057-4405-a888-a3cb59c96a6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:34.110300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2fa5e-6057-4405-a888-a3cb59c96a6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:34.112803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2fa5e-6057-4405-a888-a3cb59c96a6f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:34.127674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 320/645] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:34.128949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2fa5e-6057-4405-a888-a3cb59c96a6f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:34.130245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:34.201657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1a17-96b2-4db7-8407-b9dfcaaac5fc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:34.251027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11620ffc-e09f-479c-8bda-23e789fff989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:34.252152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2fa5e-6057-4405-a888-a3cb59c96a6f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:34.252638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11620ffc-e09f-479c-8bda-23e789fff989 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.252638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11620ffc-e09f-479c-8bda-23e789fff989 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.252791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11620ffc-e09f-479c-8bda-23e789fff989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.266044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11620ffc-e09f-479c-8bda-23e789fff989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:34.268230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11620ffc-e09f-479c-8bda-23e789fff989 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-11620ffc-e09f-479c-8bda-23e789fff989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:34.286384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:34.287502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:34.288662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:34.288662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:34.288662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:34.292723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6c1ad-66a7-49bc-a253-171475344b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:34.293383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6c1ad-66a7-49bc-a253-171475344b87 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.293667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6c1ad-66a7-49bc-a253-171475344b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.293945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6c1ad-66a7-49bc-a253-171475344b87 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.300290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 326/646] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:34.300290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11620ffc-e09f-479c-8bda-23e789fff989 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:34.310629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6c1ad-66a7-49bc-a253-171475344b87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:34.312573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6c1ad-66a7-49bc-a253-171475344b87 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-30b6c1ad-66a7-49bc-a253-171475344b87 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:34.325842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:34.326895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 321/647] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:34.327902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6c1ad-66a7-49bc-a253-171475344b87 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:34.331552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:34.415188 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:34.424392 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11620ffc-e09f-479c-8bda-23e789fff989 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:34.449183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6c1ad-66a7-49bc-a253-171475344b87 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:34.461410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2ceac-1963-4db0-a74c-fbe1815b1320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:34.462022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ceac-1963-4db0-a74c-fbe1815b1320 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.462342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ceac-1963-4db0-a74c-fbe1815b1320 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.462620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2ceac-1963-4db0-a74c-fbe1815b1320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.463349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2ceac-1963-4db0-a74c-fbe1815b1320 None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=c425b390c8dc4d799270fdd095be78b4) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:34.463651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2ceac-1963-4db0-a74c-fbe1815b1320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:34.465123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2ceac-1963-4db0-a74c-fbe1815b1320 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:34.471998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 327/648] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:34 2022] GET /identity/v3/role_assignments?user.id=c425b390c8dc4d799270fdd095be78b4&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:34.472976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2ceac-1963-4db0-a74c-fbe1815b1320 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:34.515501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83253900-04e4-466c-8173-ff8743f4bce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:34.516653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253900-04e4-466c-8173-ff8743f4bce5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.517697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253900-04e4-466c-8173-ff8743f4bce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.518546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83253900-04e4-466c-8173-ff8743f4bce5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.536187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83253900-04e4-466c-8173-ff8743f4bce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-83253900-04e4-466c-8173-ff8743f4bce5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:34.543805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:34.544892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:34.546095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:34.549294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 322/649] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:34.550998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83253900-04e4-466c-8173-ff8743f4bce5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:34.616991 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2ceac-1963-4db0-a74c-fbe1815b1320 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:34.627546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:34.674230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668442c-eba5-4219-88e9-825b1a3b4c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:34.675494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668442c-eba5-4219-88e9-825b1a3b4c07 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.675494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668442c-eba5-4219-88e9-825b1a3b4c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.675799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668442c-eba5-4219-88e9-825b1a3b4c07 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.677170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668442c-eba5-4219-88e9-825b1a3b4c07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:34.677399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668442c-eba5-4219-88e9-825b1a3b4c07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:34.679678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668442c-eba5-4219-88e9-825b1a3b4c07 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:34.682811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83253900-04e4-466c-8173-ff8743f4bce5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:34.698832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 328/650] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:34.699494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668442c-eba5-4219-88e9-825b1a3b4c07 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:34.726631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:34.732819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dc44f-59f6-4fa1-9c3e-c66c2fd88703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:34.733885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dc44f-59f6-4fa1-9c3e-c66c2fd88703 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.734384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dc44f-59f6-4fa1-9c3e-c66c2fd88703 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.734918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dc44f-59f6-4fa1-9c3e-c66c2fd88703 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.736485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dc44f-59f6-4fa1-9c3e-c66c2fd88703 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:34.740063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dc44f-59f6-4fa1-9c3e-c66c2fd88703 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:34.742098 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dc44f-59f6-4fa1-9c3e-c66c2fd88703 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:34.764881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 323/651] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Aug 18 16:51:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:34.765744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dc44f-59f6-4fa1-9c3e-c66c2fd88703 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:34.828179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668442c-eba5-4219-88e9-825b1a3b4c07 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:34.874068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f475c2-5ade-4a27-8708-c6ca0e0f574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:34.875081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f475c2-5ade-4a27-8708-c6ca0e0f574f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.875617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f475c2-5ade-4a27-8708-c6ca0e0f574f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.875893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f475c2-5ade-4a27-8708-c6ca0e0f574f None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.876884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f475c2-5ade-4a27-8708-c6ca0e0f574f None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:34.877202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f475c2-5ade-4a27-8708-c6ca0e0f574f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:34.879287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f475c2-5ade-4a27-8708-c6ca0e0f574f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:34.880837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dc44f-59f6-4fa1-9c3e-c66c2fd88703 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:34.899520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 329/652] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:34.900375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f475c2-5ade-4a27-8708-c6ca0e0f574f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:34.908272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:34.924012 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aaee4-4f20-4d05-ba83-923007980aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:34.924758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aaee4-4f20-4d05-ba83-923007980aba None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.924989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aaee4-4f20-4d05-ba83-923007980aba None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.925271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aaee4-4f20-4d05-ba83-923007980aba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.932662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aaee4-4f20-4d05-ba83-923007980aba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:34.934104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aaee4-4f20-4d05-ba83-923007980aba None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-447aaee4-4f20-4d05-ba83-923007980aba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:34.945940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:34.947139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:34.948136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 324/653] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:34.948879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee50f9-b211-4ce7-9096-3393d1550dcf None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:34.948879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee50f9-b211-4ce7-9096-3393d1550dcf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:34.948879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee50f9-b211-4ce7-9096-3393d1550dcf None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:34.951081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 325/654] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:34.952347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee50f9-b211-4ce7-9096-3393d1550dcf None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:35.006385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:35.027313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f475c2-5ade-4a27-8708-c6ca0e0f574f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:35.066239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b12e02-f793-4b1c-a37e-a03ee8c30545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:35.067107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12e02-f793-4b1c-a37e-a03ee8c30545 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:35.067551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12e02-f793-4b1c-a37e-a03ee8c30545 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:35.067866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12e02-f793-4b1c-a37e-a03ee8c30545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:35.068596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee50f9-b211-4ce7-9096-3393d1550dcf None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:35.105017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f3a7c-9892-47d1-b25a-cf4980f1bc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:35.105698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f3a7c-9892-47d1-b25a-cf4980f1bc95 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:35.106001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f3a7c-9892-47d1-b25a-cf4980f1bc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:35.106275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f3a7c-9892-47d1-b25a-cf4980f1bc95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:35.117522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f3a7c-9892-47d1-b25a-cf4980f1bc95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:35.119033 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f3a7c-9892-47d1-b25a-cf4980f1bc95 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-937f3a7c-9892-47d1-b25a-cf4980f1bc95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:35.135624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:35.136656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:35.137571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:35.137571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:35.137571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:35.144434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 326/655] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:35.145484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f3a7c-9892-47d1-b25a-cf4980f1bc95 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:35.148874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b12e02-f793-4b1c-a37e-a03ee8c30545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:35.150360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b12e02-f793-4b1c-a37e-a03ee8c30545 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:35.178929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:35.240653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:35.256472 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f3a7c-9892-47d1-b25a-cf4980f1bc95 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:35.272518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 330/656] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:35.272518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a06c-e543-4f4b-9928-64d90ca5a308 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:35.272518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a06c-e543-4f4b-9928-64d90ca5a308 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:35.272518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30a06c-e543-4f4b-9928-64d90ca5a308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:35.287703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bd30a06c-e543-4f4b-9928-64d90ca5a308 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:35.288979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bd30a06c-e543-4f4b-9928-64d90ca5a308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:35.298762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a73f4-e593-49ee-a940-3979e1ec810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:35.299457 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a73f4-e593-49ee-a940-3979e1ec810a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:35.299809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a73f4-e593-49ee-a940-3979e1ec810a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:35.300156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a73f4-e593-49ee-a940-3979e1ec810a None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:35.300984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a73f4-e593-49ee-a940-3979e1ec810a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:35.301448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a73f4-e593-49ee-a940-3979e1ec810a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:35.302871 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a73f4-e593-49ee-a940-3979e1ec810a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:35.322440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 327/657] 10.222.0.81 () {56 vars in 1137 bytes} [Thu Aug 18 16:51:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:35.323607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a73f4-e593-49ee-a940-3979e1ec810a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:35.384485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 331/658] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:35.385954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30a06c-e543-4f4b-9928-64d90ca5a308 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:35.456113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:35.468896 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a73f4-e593-49ee-a940-3979e1ec810a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:35.509561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30a06c-e543-4f4b-9928-64d90ca5a308 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:35.518889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6aee17-b465-4d42-9868-1b518e1b6c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:35.519874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aee17-b465-4d42-9868-1b518e1b6c71 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:35.520164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aee17-b465-4d42-9868-1b518e1b6c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:35.520444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aee17-b465-4d42-9868-1b518e1b6c71 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:35.521451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6aee17-b465-4d42-9868-1b518e1b6c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:35.521762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6aee17-b465-4d42-9868-1b518e1b6c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:35.523430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6aee17-b465-4d42-9868-1b518e1b6c71 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:35.523670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:35.538863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 328/659] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:35.539878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6aee17-b465-4d42-9868-1b518e1b6c71 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:35.549843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175160a5-6732-4863-8db5-afa576652d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:35.550918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175160a5-6732-4863-8db5-afa576652d60 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:35.551533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175160a5-6732-4863-8db5-afa576652d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:35.552021 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175160a5-6732-4863-8db5-afa576652d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:35.564544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175160a5-6732-4863-8db5-afa576652d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:35.566329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175160a5-6732-4863-8db5-afa576652d60 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-175160a5-6732-4863-8db5-afa576652d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:35.581282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:35.582284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:35.583208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:35.583208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:35.583208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:35.585298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 332/660] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:35.586292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175160a5-6732-4863-8db5-afa576652d60 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:35.664483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6aee17-b465-4d42-9868-1b518e1b6c71 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:35.703603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2938b0c-c246-40fe-97c2-da7dbfefb263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:35.704907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2938b0c-c246-40fe-97c2-da7dbfefb263 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:35.705301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2938b0c-c246-40fe-97c2-da7dbfefb263 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:35.705582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2938b0c-c246-40fe-97c2-da7dbfefb263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:35.711376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175160a5-6732-4863-8db5-afa576652d60 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:35.733898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:35.775171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afbc31-601d-4f85-898e-0b6f5eedbdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:35.776208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afbc31-601d-4f85-898e-0b6f5eedbdfc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:35.776710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afbc31-601d-4f85-898e-0b6f5eedbdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:35.777170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afbc31-601d-4f85-898e-0b6f5eedbdfc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:35.790364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afbc31-601d-4f85-898e-0b6f5eedbdfc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:35.792632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afbc31-601d-4f85-898e-0b6f5eedbdfc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b6afbc31-601d-4f85-898e-0b6f5eedbdfc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:35.811317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:35.813957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 333/661] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:35.816006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afbc31-601d-4f85-898e-0b6f5eedbdfc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:35.822391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2938b0c-c246-40fe-97c2-da7dbfefb263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:35.824819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2938b0c-c246-40fe-97c2-da7dbfefb263 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:35.855762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:35.957988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afbc31-601d-4f85-898e-0b6f5eedbdfc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:35.963418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 329/662] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:35.964390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2938b0c-c246-40fe-97c2-da7dbfefb263 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:35.994302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eececb5-2dac-4612-a6fb-78e00fcd2929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:35.995208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eececb5-2dac-4612-a6fb-78e00fcd2929 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:35.995686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eececb5-2dac-4612-a6fb-78e00fcd2929 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:35.996130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eececb5-2dac-4612-a6fb-78e00fcd2929 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:35.996991 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eececb5-2dac-4612-a6fb-78e00fcd2929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:35.997452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eececb5-2dac-4612-a6fb-78e00fcd2929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:35.998982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eececb5-2dac-4612-a6fb-78e00fcd2929 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:36.012402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 334/663] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:36.017241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eececb5-2dac-4612-a6fb-78e00fcd2929 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.022344 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:36.079130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2938b0c-c246-40fe-97c2-da7dbfefb263 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.113099 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:36.119123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2149dcd-0cbf-4dae-802a-97720eafa013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:36.119772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2149dcd-0cbf-4dae-802a-97720eafa013 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.120203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2149dcd-0cbf-4dae-802a-97720eafa013 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.120514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2149dcd-0cbf-4dae-802a-97720eafa013 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.129443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eececb5-2dac-4612-a6fb-78e00fcd2929 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.134183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2149dcd-0cbf-4dae-802a-97720eafa013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e2149dcd-0cbf-4dae-802a-97720eafa013 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:36.139893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:36.140956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:36.141833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:36.142494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 330/664] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:36.143124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2149dcd-0cbf-4dae-802a-97720eafa013 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.169613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeaf50-dc37-41bf-b5e6-959f7c850bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:36.170334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeaf50-dc37-41bf-b5e6-959f7c850bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.170670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeaf50-dc37-41bf-b5e6-959f7c850bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.171004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeaf50-dc37-41bf-b5e6-959f7c850bb0 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.171798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeaf50-dc37-41bf-b5e6-959f7c850bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:36.172169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeaf50-dc37-41bf-b5e6-959f7c850bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:36.174306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeaf50-dc37-41bf-b5e6-959f7c850bb0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:36.196408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 335/665] 10.222.0.81 () {56 vars in 1139 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:36.196408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeaf50-dc37-41bf-b5e6-959f7c850bb0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.270458 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2149dcd-0cbf-4dae-802a-97720eafa013 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.286590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:36.303530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeaf50-dc37-41bf-b5e6-959f7c850bb0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.312140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f8c6c-7da8-470e-92ef-5229d65f45d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:36.312578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f8c6c-7da8-470e-92ef-5229d65f45d7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.312851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f8c6c-7da8-470e-92ef-5229d65f45d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.313126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f8c6c-7da8-470e-92ef-5229d65f45d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.324489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f8c6c-7da8-470e-92ef-5229d65f45d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:36.325918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f8c6c-7da8-470e-92ef-5229d65f45d7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f37f8c6c-7da8-470e-92ef-5229d65f45d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:36.341134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:36.342177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:36.343110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:36.343110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:36.343110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:36.343110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 331/666] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:36.343110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f8c6c-7da8-470e-92ef-5229d65f45d7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.350243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaee739-277b-46e3-9372-08a99af434e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:36.350898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaee739-277b-46e3-9372-08a99af434e0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.351184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaee739-277b-46e3-9372-08a99af434e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.351461 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaee739-277b-46e3-9372-08a99af434e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.359892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaee739-277b-46e3-9372-08a99af434e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:36.362023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaee739-277b-46e3-9372-08a99af434e0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2aaee739-277b-46e3-9372-08a99af434e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:36.374342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:36.375298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:36.377455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:36.377455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:36.377455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:36.377455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:36.377455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:36.377455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:36.377455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:36.377455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:36.377455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 336/667] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:36.377976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaee739-277b-46e3-9372-08a99af434e0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.380530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:36.460088 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f8c6c-7da8-470e-92ef-5229d65f45d7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.487339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaee739-277b-46e3-9372-08a99af434e0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.497228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7aecb2-987f-48e4-9a38-8f4f551079b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:36.497840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7aecb2-987f-48e4-9a38-8f4f551079b3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.498127 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7aecb2-987f-48e4-9a38-8f4f551079b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.498400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7aecb2-987f-48e4-9a38-8f4f551079b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.499061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7aecb2-987f-48e4-9a38-8f4f551079b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:36.499371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7aecb2-987f-48e4-9a38-8f4f551079b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:36.500762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7aecb2-987f-48e4-9a38-8f4f551079b3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:36.514523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 332/668] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:36.514523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7aecb2-987f-48e4-9a38-8f4f551079b3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.523924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebdc93-aa6a-4b8f-910f-7ad44effdfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:36.524449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebdc93-aa6a-4b8f-910f-7ad44effdfca None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.524761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebdc93-aa6a-4b8f-910f-7ad44effdfca None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.525038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebdc93-aa6a-4b8f-910f-7ad44effdfca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.543876 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:36.593033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebdc93-aa6a-4b8f-910f-7ad44effdfca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:36.595160 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebdc93-aa6a-4b8f-910f-7ad44effdfca None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:36.596998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:36.619916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7aecb2-987f-48e4-9a38-8f4f551079b3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.653130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146561f4-9f5a-4ac0-a7bc-f77b5fcc0470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:36.653750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146561f4-9f5a-4ac0-a7bc-f77b5fcc0470 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.654033 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146561f4-9f5a-4ac0-a7bc-f77b5fcc0470 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.654329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146561f4-9f5a-4ac0-a7bc-f77b5fcc0470 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.654978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146561f4-9f5a-4ac0-a7bc-f77b5fcc0470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:36.655282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146561f4-9f5a-4ac0-a7bc-f77b5fcc0470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:36.656673 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146561f4-9f5a-4ac0-a7bc-f77b5fcc0470 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:36.668908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 333/669] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:36.669779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146561f4-9f5a-4ac0-a7bc-f77b5fcc0470 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.696247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 337/670] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:36.697206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebdc93-aa6a-4b8f-910f-7ad44effdfca None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.755958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:36.771618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146561f4-9f5a-4ac0-a7bc-f77b5fcc0470 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.795010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebdc93-aa6a-4b8f-910f-7ad44effdfca None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.796440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:36.805372 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54149cc2-78ca-4bf8-b175-0df290673e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:36.805984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54149cc2-78ca-4bf8-b175-0df290673e08 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.806260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54149cc2-78ca-4bf8-b175-0df290673e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.806528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54149cc2-78ca-4bf8-b175-0df290673e08 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.807214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54149cc2-78ca-4bf8-b175-0df290673e08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:36.807519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54149cc2-78ca-4bf8-b175-0df290673e08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:36.808967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54149cc2-78ca-4bf8-b175-0df290673e08 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:36.820753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 334/671] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:36.821953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6eb7f-f81f-4c40-ad95-58d025c09680 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.822233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6eb7f-f81f-4c40-ad95-58d025c09680 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.822514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6eb7f-f81f-4c40-ad95-58d025c09680 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.824003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 335/672] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:36.824736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6eb7f-f81f-4c40-ad95-58d025c09680 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.832773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29311a2-4c79-4950-8367-57a1acca7074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:36.833410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29311a2-4c79-4950-8367-57a1acca7074 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.833692 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29311a2-4c79-4950-8367-57a1acca7074 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.833972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29311a2-4c79-4950-8367-57a1acca7074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.843887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29311a2-4c79-4950-8367-57a1acca7074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:36.845893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29311a2-4c79-4950-8367-57a1acca7074 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a29311a2-4c79-4950-8367-57a1acca7074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:36.859985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:36.866624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:36.867844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:36.867844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:36.867844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:36.867844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 338/673] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:36.867844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29311a2-4c79-4950-8367-57a1acca7074 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.927589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6eb7f-f81f-4c40-ad95-58d025c09680 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.961259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d380-ca7f-4f95-a053-ae3d8373cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:36.961896 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d380-ca7f-4f95-a053-ae3d8373cd02 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:36.962179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d380-ca7f-4f95-a053-ae3d8373cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:36.962452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d380-ca7f-4f95-a053-ae3d8373cd02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:36.969102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d380-ca7f-4f95-a053-ae3d8373cd02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:36.969366 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29311a2-4c79-4950-8367-57a1acca7074 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:36.971100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d380-ca7f-4f95-a053-ae3d8373cd02 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fb38d380-ca7f-4f95-a053-ae3d8373cd02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:36.983196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:36.984283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:36.985481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:36.985481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:36.985481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:36.985481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:36.985481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:36.985481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:36.985481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:36.985481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:36.988593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 336/674] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:36.989843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d380-ca7f-4f95-a053-ae3d8373cd02 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:36.993243 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:37.004363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98292a7-1215-48f0-96e4-ef4c52df108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:37.005021 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98292a7-1215-48f0-96e4-ef4c52df108b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.005298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98292a7-1215-48f0-96e4-ef4c52df108b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.005570 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98292a7-1215-48f0-96e4-ef4c52df108b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.015974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98292a7-1215-48f0-96e4-ef4c52df108b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:37.018007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98292a7-1215-48f0-96e4-ef4c52df108b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e98292a7-1215-48f0-96e4-ef4c52df108b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:37.031967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:37.033193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:37.034291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:37.034291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:37.034291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:37.034291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 339/675] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:37.034594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e641f-817d-43fb-a97c-18a3ee000a4f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.034876 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e641f-817d-43fb-a97c-18a3ee000a4f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.035151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e641f-817d-43fb-a97c-18a3ee000a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.047528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:37.053321 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-421e641f-817d-43fb-a97c-18a3ee000a4f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:37.054529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-421e641f-817d-43fb-a97c-18a3ee000a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:37.095837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d380-ca7f-4f95-a053-ae3d8373cd02 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:37.122987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 340/676] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:37.123830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e641f-817d-43fb-a97c-18a3ee000a4f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:37.131298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368af75-1278-4c5a-8208-ec13911588be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:37.131907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368af75-1278-4c5a-8208-ec13911588be None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.132603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368af75-1278-4c5a-8208-ec13911588be None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.132964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368af75-1278-4c5a-8208-ec13911588be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.133610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368af75-1278-4c5a-8208-ec13911588be None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=a710cfeadd004a8bbf932f6bb3b211e5) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:37.134038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368af75-1278-4c5a-8208-ec13911588be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:37.135820 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368af75-1278-4c5a-8208-ec13911588be None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:37.142602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 337/677] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:36 2022] GET /identity/v3/role_assignments?user.id=a710cfeadd004a8bbf932f6bb3b211e5&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:37.143639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368af75-1278-4c5a-8208-ec13911588be None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:37.240239 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:37.255780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e641f-817d-43fb-a97c-18a3ee000a4f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:37.291062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368af75-1278-4c5a-8208-ec13911588be None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:37.299095 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c15bc3-3759-4adb-8143-3c9f53ddd6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:37.299646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15bc3-3759-4adb-8143-3c9f53ddd6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.299925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15bc3-3759-4adb-8143-3c9f53ddd6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.300247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15bc3-3759-4adb-8143-3c9f53ddd6b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.300928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c15bc3-3759-4adb-8143-3c9f53ddd6b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:37.301252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c15bc3-3759-4adb-8143-3c9f53ddd6b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:37.302616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c15bc3-3759-4adb-8143-3c9f53ddd6b0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:37.305553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:37.318730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 341/678] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:37.320026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c15bc3-3759-4adb-8143-3c9f53ddd6b0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:37.347454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aebfe-7455-47e5-92f4-677975f6f7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:37.348172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aebfe-7455-47e5-92f4-677975f6f7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.348451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aebfe-7455-47e5-92f4-677975f6f7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.348746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aebfe-7455-47e5-92f4-677975f6f7f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.349444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37aebfe-7455-47e5-92f4-677975f6f7f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:37.349750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37aebfe-7455-47e5-92f4-677975f6f7f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:37.351167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37aebfe-7455-47e5-92f4-677975f6f7f2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:37.365221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 338/679] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:37.366152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aebfe-7455-47e5-92f4-677975f6f7f2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:37.445752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c15bc3-3759-4adb-8143-3c9f53ddd6b0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:37.482078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf305d8-8b7a-4ffe-afab-97f1dbb86a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:37.482687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf305d8-8b7a-4ffe-afab-97f1dbb86a4a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.482969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf305d8-8b7a-4ffe-afab-97f1dbb86a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.483242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf305d8-8b7a-4ffe-afab-97f1dbb86a4a None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.483880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf305d8-8b7a-4ffe-afab-97f1dbb86a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:37.484177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf305d8-8b7a-4ffe-afab-97f1dbb86a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:37.484421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aebfe-7455-47e5-92f4-677975f6f7f2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:37.485640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf305d8-8b7a-4ffe-afab-97f1dbb86a4a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:37.498657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 342/680] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:37.499482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf305d8-8b7a-4ffe-afab-97f1dbb86a4a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:37.518792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:37.528888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a81c6f-3bb1-42ed-85dc-a31f31cc9f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:37.529560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a81c6f-3bb1-42ed-85dc-a31f31cc9f63 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.529901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a81c6f-3bb1-42ed-85dc-a31f31cc9f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.530172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a81c6f-3bb1-42ed-85dc-a31f31cc9f63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.539652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a81c6f-3bb1-42ed-85dc-a31f31cc9f63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:37.541317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a81c6f-3bb1-42ed-85dc-a31f31cc9f63 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e5a81c6f-3bb1-42ed-85dc-a31f31cc9f63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:37.554102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:37.555371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 339/681] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:37.557370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a81c6f-3bb1-42ed-85dc-a31f31cc9f63 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:37.570481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:37.618055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf305d8-8b7a-4ffe-afab-97f1dbb86a4a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:37.654785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91132c0-dca3-4e2b-88ca-7d49b1af0696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:37.655395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91132c0-dca3-4e2b-88ca-7d49b1af0696 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.655675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91132c0-dca3-4e2b-88ca-7d49b1af0696 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.655948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91132c0-dca3-4e2b-88ca-7d49b1af0696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.656712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91132c0-dca3-4e2b-88ca-7d49b1af0696 None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=2aa331983fbc4b18b7880084adcba3c5) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:37.657022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91132c0-dca3-4e2b-88ca-7d49b1af0696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:37.658815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91132c0-dca3-4e2b-88ca-7d49b1af0696 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:37.663014 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a81c6f-3bb1-42ed-85dc-a31f31cc9f63 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:37.667221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 343/682] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:37 2022] GET /identity/v3/role_assignments?user.id=2aa331983fbc4b18b7880084adcba3c5&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:37.668429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91132c0-dca3-4e2b-88ca-7d49b1af0696 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:37.712583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab048a-c26a-405e-b4d4-aae8359409f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:37.713639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab048a-c26a-405e-b4d4-aae8359409f0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.714127 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab048a-c26a-405e-b4d4-aae8359409f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.714602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab048a-c26a-405e-b4d4-aae8359409f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.733437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab048a-c26a-405e-b4d4-aae8359409f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-afab048a-c26a-405e-b4d4-aae8359409f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:37.746838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:37.747879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:37.748799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:37.752395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 340/683] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:37.753712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab048a-c26a-405e-b4d4-aae8359409f0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:37.788391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91132c0-dca3-4e2b-88ca-7d49b1af0696 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:37.811670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:37.815030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:37.834326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa098b7-2860-493d-9712-b1290816a29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:37.834878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa098b7-2860-493d-9712-b1290816a29e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.835161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa098b7-2860-493d-9712-b1290816a29e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.835434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa098b7-2860-493d-9712-b1290816a29e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.842862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa098b7-2860-493d-9712-b1290816a29e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:37.844346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa098b7-2860-493d-9712-b1290816a29e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5aa098b7-2860-493d-9712-b1290816a29e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:37.857298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:37.858257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:37.859177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:37.859177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:37.859177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:37.859177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:37.859177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:37.859177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:37.859177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:37.859177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:37.863630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 344/684] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:37.864851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa098b7-2860-493d-9712-b1290816a29e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:37.889825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab048a-c26a-405e-b4d4-aae8359409f0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:37.940846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8e0fc-c99d-4fef-876d-edf974a806e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:37.941467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8e0fc-c99d-4fef-876d-edf974a806e8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:37.941998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8e0fc-c99d-4fef-876d-edf974a806e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:37.942289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8e0fc-c99d-4fef-876d-edf974a806e8 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:37.943622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8e0fc-c99d-4fef-876d-edf974a806e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:37.944056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8e0fc-c99d-4fef-876d-edf974a806e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:37.945552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8e0fc-c99d-4fef-876d-edf974a806e8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:37.970128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 341/685] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Aug 18 16:51:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:37.970987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8e0fc-c99d-4fef-876d-edf974a806e8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:37.996408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa098b7-2860-493d-9712-b1290816a29e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:38.043725 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229678-f0fe-486d-94f3-e161a26ede35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:38.044489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229678-f0fe-486d-94f3-e161a26ede35 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:38.044902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229678-f0fe-486d-94f3-e161a26ede35 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:38.045186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229678-f0fe-486d-94f3-e161a26ede35 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:38.045867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c229678-f0fe-486d-94f3-e161a26ede35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:38.046424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c229678-f0fe-486d-94f3-e161a26ede35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:38.049167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c229678-f0fe-486d-94f3-e161a26ede35 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:38.063009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 345/686] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:38.064092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229678-f0fe-486d-94f3-e161a26ede35 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:38.082161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8e0fc-c99d-4fef-876d-edf974a806e8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:38.091078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:38.122515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdd7a9-5426-4b83-8da4-2606ec2a7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:38.123272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdd7a9-5426-4b83-8da4-2606ec2a7dcc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:38.123649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdd7a9-5426-4b83-8da4-2606ec2a7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:38.124017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdd7a9-5426-4b83-8da4-2606ec2a7dcc None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:38.124627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:38.124933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdd7a9-5426-4b83-8da4-2606ec2a7dcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:38.125528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdd7a9-5426-4b83-8da4-2606ec2a7dcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:38.127449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdd7a9-5426-4b83-8da4-2606ec2a7dcc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:38.144843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 342/687] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:38.144843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdd7a9-5426-4b83-8da4-2606ec2a7dcc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:38.214701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229678-f0fe-486d-94f3-e161a26ede35 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:38.260129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6519a-289b-459e-8ca8-cd164c288fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:38.260787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6519a-289b-459e-8ca8-cd164c288fce None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:38.261066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6519a-289b-459e-8ca8-cd164c288fce None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:38.261340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6519a-289b-459e-8ca8-cd164c288fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:38.264627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdd7a9-5426-4b83-8da4-2606ec2a7dcc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:38.314639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0353504-6faa-43bc-b107-90293963a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:38.316617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353504-6faa-43bc-b107-90293963a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:38.317164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353504-6faa-43bc-b107-90293963a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:38.317621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353504-6faa-43bc-b107-90293963a0b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:38.333734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0353504-6faa-43bc-b107-90293963a0b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:38.336451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0353504-6faa-43bc-b107-90293963a0b4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:38.336937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6519a-289b-459e-8ca8-cd164c288fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:38.338536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6519a-289b-459e-8ca8-cd164c288fce None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a0353504-6faa-43bc-b107-90293963a0b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:38.357544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:38.358589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:38.359489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:38.359489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:38.359489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:38.361774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 343/688] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:38.362821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0353504-6faa-43bc-b107-90293963a0b4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:38.393241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:38.401958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:38.486868 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 346/689] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:38.488069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6519a-289b-459e-8ca8-cd164c288fce None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:38.492836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0353504-6faa-43bc-b107-90293963a0b4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:38.530197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a11e8e-76a3-42e9-948c-0a26efd2848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:38.530955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a11e8e-76a3-42e9-948c-0a26efd2848e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:38.531336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a11e8e-76a3-42e9-948c-0a26efd2848e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:38.531750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a11e8e-76a3-42e9-948c-0a26efd2848e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:38.532621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a11e8e-76a3-42e9-948c-0a26efd2848e None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=7b1fde904acd460899d8c736f5762056) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:38.533043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a11e8e-76a3-42e9-948c-0a26efd2848e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:38.535312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a11e8e-76a3-42e9-948c-0a26efd2848e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:38.549110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 344/690] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:38 2022] GET /identity/v3/role_assignments?user.id=7b1fde904acd460899d8c736f5762056&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:38.549110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a11e8e-76a3-42e9-948c-0a26efd2848e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:38.694560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6519a-289b-459e-8ca8-cd164c288fce None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:38.739911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:38.765135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb134a-40d4-4ead-a0f8-8cfaa1c67688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:38.765823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb134a-40d4-4ead-a0f8-8cfaa1c67688 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:38.766103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb134a-40d4-4ead-a0f8-8cfaa1c67688 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:38.766412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb134a-40d4-4ead-a0f8-8cfaa1c67688 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:38.767052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb134a-40d4-4ead-a0f8-8cfaa1c67688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:38.767357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb134a-40d4-4ead-a0f8-8cfaa1c67688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:38.767862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a11e8e-76a3-42e9-948c-0a26efd2848e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:38.768796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb134a-40d4-4ead-a0f8-8cfaa1c67688 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:38.786048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 347/691] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:38.791637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb134a-40d4-4ead-a0f8-8cfaa1c67688 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:38.794731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:38.810081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4b8f8-2b74-46f8-a0b9-c14ce48da805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:38.811507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4b8f8-2b74-46f8-a0b9-c14ce48da805 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:38.812072 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4b8f8-2b74-46f8-a0b9-c14ce48da805 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:38.812565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4b8f8-2b74-46f8-a0b9-c14ce48da805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:38.827890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4b8f8-2b74-46f8-a0b9-c14ce48da805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:38.830919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4b8f8-2b74-46f8-a0b9-c14ce48da805 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-26d4b8f8-2b74-46f8-a0b9-c14ce48da805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:38.849694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:38.850812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:38.851731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:38.851731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:38.851731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:38.854235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 345/692] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:38.863090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4b8f8-2b74-46f8-a0b9-c14ce48da805 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:38.921295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb134a-40d4-4ead-a0f8-8cfaa1c67688 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:38.968082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bbdac-704b-45ce-a070-cf383c8a2a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:38.968851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bbdac-704b-45ce-a070-cf383c8a2a75 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:38.970053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bbdac-704b-45ce-a070-cf383c8a2a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:38.970217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bbdac-704b-45ce-a070-cf383c8a2a75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:38.978787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bbdac-704b-45ce-a070-cf383c8a2a75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:38.980420 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bbdac-704b-45ce-a070-cf383c8a2a75 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:38.997083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4b8f8-2b74-46f8-a0b9-c14ce48da805 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-325bbdac-704b-45ce-a070-cf383c8a2a75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:38.997277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:38.998285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:38.999237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:38.999237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:38.999237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:38.999237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:38.999237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:38.999237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:38.999237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:38.999237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:38.999237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:38.999237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:39.004954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 348/693] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Aug 18 16:51:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:39.011061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bbdac-704b-45ce-a070-cf383c8a2a75 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:39.036723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba9c16-e93d-48b3-ac46-da854cf29ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:39.037700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba9c16-e93d-48b3-ac46-da854cf29ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.038258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba9c16-e93d-48b3-ac46-da854cf29ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.038743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba9c16-e93d-48b3-ac46-da854cf29ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.039643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba9c16-e93d-48b3-ac46-da854cf29ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:39.040149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba9c16-e93d-48b3-ac46-da854cf29ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:39.041887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba9c16-e93d-48b3-ac46-da854cf29ef8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:39.055716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:39.056275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 346/694] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:39.063169 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba9c16-e93d-48b3-ac46-da854cf29ef8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:39.150044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:39.174425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba9c16-e93d-48b3-ac46-da854cf29ef8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:39.226847 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bbdac-704b-45ce-a070-cf383c8a2a75 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:39.230386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72af928-bf3b-467e-b171-cdf92db02590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:39.231285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72af928-bf3b-467e-b171-cdf92db02590 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.231987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72af928-bf3b-467e-b171-cdf92db02590 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.233170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72af928-bf3b-467e-b171-cdf92db02590 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.245607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72af928-bf3b-467e-b171-cdf92db02590 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:39.250260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72af928-bf3b-467e-b171-cdf92db02590 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b72af928-bf3b-467e-b171-cdf92db02590 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:39.270410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:39.271391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:39.272317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:39.272317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:39.272317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:39.272317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:39.272317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:39.272317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:39.272317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:39.272317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:39.272317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 347/695] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:39.277198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72af928-bf3b-467e-b171-cdf92db02590 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:39.295661 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca8abb-308a-4505-9a06-fbd3428585de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:39.296505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca8abb-308a-4505-9a06-fbd3428585de None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.296818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca8abb-308a-4505-9a06-fbd3428585de None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.297107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca8abb-308a-4505-9a06-fbd3428585de None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.298460 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca8abb-308a-4505-9a06-fbd3428585de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:39.298694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca8abb-308a-4505-9a06-fbd3428585de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:39.300150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca8abb-308a-4505-9a06-fbd3428585de None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:39.320714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 349/696] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Aug 18 16:51:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:39.323652 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c2195-8f13-41d2-8489-23270ff9179e None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.323936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c2195-8f13-41d2-8489-23270ff9179e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.324215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c2195-8f13-41d2-8489-23270ff9179e None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.325947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 350/697] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:39.326669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c2195-8f13-41d2-8489-23270ff9179e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:39.346703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:39.407178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72af928-bf3b-467e-b171-cdf92db02590 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:39.447167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1fee1-8de1-4374-89d9-5925f56cc9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:39.447789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1fee1-8de1-4374-89d9-5925f56cc9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.448073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1fee1-8de1-4374-89d9-5925f56cc9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.448351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1fee1-8de1-4374-89d9-5925f56cc9b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.449084 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1fee1-8de1-4374-89d9-5925f56cc9b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:39.449395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1fee1-8de1-4374-89d9-5925f56cc9b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:39.450822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1fee1-8de1-4374-89d9-5925f56cc9b4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:39.463872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 348/698] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:39.464270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c2195-8f13-41d2-8489-23270ff9179e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:39.465237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed67af-0399-4364-993c-031c2ed48975 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.465537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed67af-0399-4364-993c-031c2ed48975 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.465886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed67af-0399-4364-993c-031c2ed48975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.484290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-37ed67af-0399-4364-993c-031c2ed48975 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:39.486076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-37ed67af-0399-4364-993c-031c2ed48975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:39.488860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:39.505561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8e7f1-7dd1-4164-ad46-cf99f5102a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:39.506553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8e7f1-7dd1-4164-ad46-cf99f5102a94 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.507031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8e7f1-7dd1-4164-ad46-cf99f5102a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.507529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8e7f1-7dd1-4164-ad46-cf99f5102a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.566940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 349/699] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:39.567849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed67af-0399-4364-993c-031c2ed48975 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:39.579858 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8e7f1-7dd1-4164-ad46-cf99f5102a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:39.581628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8e7f1-7dd1-4164-ad46-cf99f5102a94 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:39.651085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:39.686347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 351/700] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:39.691423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8e7f1-7dd1-4164-ad46-cf99f5102a94 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:39.731180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:39.766983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed67af-0399-4364-993c-031c2ed48975 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:39.824580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa4a95-c770-4be1-b0a7-9c216307784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:39.825194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa4a95-c770-4be1-b0a7-9c216307784f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.825472 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa4a95-c770-4be1-b0a7-9c216307784f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.825742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa4a95-c770-4be1-b0a7-9c216307784f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.826948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa4a95-c770-4be1-b0a7-9c216307784f None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=4ee382ab3c8945f1b39b14b00d9237ba) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:39.827262 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa4a95-c770-4be1-b0a7-9c216307784f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:39.829003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa4a95-c770-4be1-b0a7-9c216307784f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:39.837443 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 350/701] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:39 2022] GET /identity/v3/role_assignments?user.id=4ee382ab3c8945f1b39b14b00d9237ba&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:39.838964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487d4c-cdf4-449f-8dfc-04a984630cdf None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.839244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487d4c-cdf4-449f-8dfc-04a984630cdf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.839516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9487d4c-cdf4-449f-8dfc-04a984630cdf None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.846255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 351/702] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:39.848883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ad52-ba9e-493c-8e24-4d61b89f65f5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.849173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ad52-ba9e-493c-8e24-4d61b89f65f5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.849447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ad52-ba9e-493c-8e24-4d61b89f65f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.853609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8e7f1-7dd1-4164-ad46-cf99f5102a94 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:39.871661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0983ad52-ba9e-493c-8e24-4d61b89f65f5 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:39.872995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0983ad52-ba9e-493c-8e24-4d61b89f65f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:39.941322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77077a6-c7ef-40ae-b345-3a01f8c3d1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:39.942094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77077a6-c7ef-40ae-b345-3a01f8c3d1dd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:39.942408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77077a6-c7ef-40ae-b345-3a01f8c3d1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:39.942687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77077a6-c7ef-40ae-b345-3a01f8c3d1dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:39.956449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77077a6-c7ef-40ae-b345-3a01f8c3d1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:39.958521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77077a6-c7ef-40ae-b345-3a01f8c3d1dd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:39.959248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 352/703] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:39.960383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ad52-ba9e-493c-8e24-4d61b89f65f5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f77077a6-c7ef-40ae-b345-3a01f8c3d1dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:39.992581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:39.993671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:39.994579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:39.994579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:39.994579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:39.994579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 352/704] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:39.999558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77077a6-c7ef-40ae-b345-3a01f8c3d1dd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:40.051505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:40.110343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:40.155077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ad52-ba9e-493c-8e24-4d61b89f65f5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:40.161047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77077a6-c7ef-40ae-b345-3a01f8c3d1dd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:40.207247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3863b1-e0c2-4c55-86e1-f59b24475089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:40.207790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487c269-a6c5-4412-9fca-742ef412fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:40.208486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487c269-a6c5-4412-9fca-742ef412fea5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:40.208844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487c269-a6c5-4412-9fca-742ef412fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:40.209101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3863b1-e0c2-4c55-86e1-f59b24475089 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:40.209205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487c269-a6c5-4412-9fca-742ef412fea5 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:40.210303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3863b1-e0c2-4c55-86e1-f59b24475089 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:40.210425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487c269-a6c5-4412-9fca-742ef412fea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:40.210425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487c269-a6c5-4412-9fca-742ef412fea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:40.210962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3863b1-e0c2-4c55-86e1-f59b24475089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:40.211397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487c269-a6c5-4412-9fca-742ef412fea5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:40.226475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 353/705] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:40.229327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3863b1-e0c2-4c55-86e1-f59b24475089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:40.231550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3863b1-e0c2-4c55-86e1-f59b24475089 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:40.231901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487c269-a6c5-4412-9fca-742ef412fea5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-3b3863b1-e0c2-4c55-86e1-f59b24475089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:40.252515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:40.253694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:40.254738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:40.254738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:40.254738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:40.254738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 353/706] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:40.265492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3863b1-e0c2-4c55-86e1-f59b24475089 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:40.367776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487c269-a6c5-4412-9fca-742ef412fea5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:40.391446 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:40.405617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3863b1-e0c2-4c55-86e1-f59b24475089 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:40.414350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:40.421442 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55150767-4d03-406d-ae92-1bef7de8c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:40.422740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55150767-4d03-406d-ae92-1bef7de8c1cd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:40.424010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55150767-4d03-406d-ae92-1bef7de8c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:40.424494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55150767-4d03-406d-ae92-1bef7de8c1cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:40.434843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55150767-4d03-406d-ae92-1bef7de8c1cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:40.437477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55150767-4d03-406d-ae92-1bef7de8c1cd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:40.450097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6ca54-cf22-44e8-b52d-8438a6b67703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:40.450747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6ca54-cf22-44e8-b52d-8438a6b67703 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:40.451040 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6ca54-cf22-44e8-b52d-8438a6b67703 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:40.451316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6ca54-cf22-44e8-b52d-8438a6b67703 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:40.451971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6ca54-cf22-44e8-b52d-8438a6b67703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:40.452274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6ca54-cf22-44e8-b52d-8438a6b67703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:40.453712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6ca54-cf22-44e8-b52d-8438a6b67703 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-55150767-4d03-406d-ae92-1bef7de8c1cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:40.455101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:40.456337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:40.457719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:40.457719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:40.457719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:40.457719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:40.457719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:40.457719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:40.457719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:40.457719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:40.460878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 354/707] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:40.462066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55150767-4d03-406d-ae92-1bef7de8c1cd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:40.473348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 354/708] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:40.474462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6ca54-cf22-44e8-b52d-8438a6b67703 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:40.600280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55150767-4d03-406d-ae92-1bef7de8c1cd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:40.606316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6ca54-cf22-44e8-b52d-8438a6b67703 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:40.640079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575078a-e69d-4509-ae62-041074a6cd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:40.640911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575078a-e69d-4509-ae62-041074a6cd60 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:40.641294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575078a-e69d-4509-ae62-041074a6cd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:40.641738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575078a-e69d-4509-ae62-041074a6cd60 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:40.642547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575078a-e69d-4509-ae62-041074a6cd60 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:40.644238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575078a-e69d-4509-ae62-041074a6cd60 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:40.648892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae2e08-e71c-4c61-9007-981ce7287ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:40.649854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae2e08-e71c-4c61-9007-981ce7287ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:40.650336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae2e08-e71c-4c61-9007-981ce7287ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:40.650870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae2e08-e71c-4c61-9007-981ce7287ab7 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:40.651825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae2e08-e71c-4c61-9007-981ce7287ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:40.652350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae2e08-e71c-4c61-9007-981ce7287ab7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:40.654168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae2e08-e71c-4c61-9007-981ce7287ab7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-9575078a-e69d-4509-ae62-041074a6cd60 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:40.656635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:40.658510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:51:40.659516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:40.663288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 355/709] 10.222.0.81 () {56 vars in 1129 bytes} [Thu Aug 18 16:51:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:40.664166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575078a-e69d-4509-ae62-041074a6cd60 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:40.674607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 355/710] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:40.675902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae2e08-e71c-4c61-9007-981ce7287ab7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:40.691550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:40.743988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:40.795528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575078a-e69d-4509-ae62-041074a6cd60 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:40.796994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae2e08-e71c-4c61-9007-981ce7287ab7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:40.838180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b80ed-af54-4f39-9bd0-9ebbd3fd69ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:40.838953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b80ed-af54-4f39-9bd0-9ebbd3fd69ad None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:40.839397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b80ed-af54-4f39-9bd0-9ebbd3fd69ad None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:40.839849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b80ed-af54-4f39-9bd0-9ebbd3fd69ad None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:40.840188 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca3a34-62db-4a53-ad29-25090a394a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:40.840676 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b80ed-af54-4f39-9bd0-9ebbd3fd69ad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:40.841092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b80ed-af54-4f39-9bd0-9ebbd3fd69ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:40.841430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3a34-62db-4a53-ad29-25090a394a58 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:40.841885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3a34-62db-4a53-ad29-25090a394a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:40.842328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3a34-62db-4a53-ad29-25090a394a58 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:40.842907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b80ed-af54-4f39-9bd0-9ebbd3fd69ad None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:40.843334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca3a34-62db-4a53-ad29-25090a394a58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:40.845293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca3a34-62db-4a53-ad29-25090a394a58 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:40.853509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 356/711] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Aug 18 16:51:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:40.853509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b80ed-af54-4f39-9bd0-9ebbd3fd69ad None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:40.875446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 356/712] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:51:40 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:51:40.877345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca3a34-62db-4a53-ad29-25090a394a58 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:40.946004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:40.987030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b80ed-af54-4f39-9bd0-9ebbd3fd69ad None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:41.007435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca3a34-62db-4a53-ad29-25090a394a58 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:41.023588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:41.030746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f798-d407-42ca-8118-06e970becfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:41.031413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f798-d407-42ca-8118-06e970becfdc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:41.031699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f798-d407-42ca-8118-06e970becfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:41.032659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f798-d407-42ca-8118-06e970becfdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:41.033484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f798-d407-42ca-8118-06e970becfdc None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=c425b390c8dc4d799270fdd095be78b4) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:41.033904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f798-d407-42ca-8118-06e970becfdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:41.035538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f798-d407-42ca-8118-06e970becfdc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:41.042069 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 357/713] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:40 2022] GET /identity/v3/role_assignments?user.id=c425b390c8dc4d799270fdd095be78b4&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=56228137a4444ef9b7e688d04abd00fd => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:41.043519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983b585-d4a4-4506-8d18-03b51acb99c6 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:41.043921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983b585-d4a4-4506-8d18-03b51acb99c6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:41.044196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983b585-d4a4-4506-8d18-03b51acb99c6 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:41.045922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 358/714] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:41.054959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616e17-6d42-4a21-a5df-ddda798a9cdb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:41.055314 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616e17-6d42-4a21-a5df-ddda798a9cdb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:41.055600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3616e17-6d42-4a21-a5df-ddda798a9cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:41.055704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50667f4-edce-4367-b5a5-ed02400c4526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:41.056253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50667f4-edce-4367-b5a5-ed02400c4526 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:41.056584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50667f4-edce-4367-b5a5-ed02400c4526 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:41.056863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50667f4-edce-4367-b5a5-ed02400c4526 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:41.057519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50667f4-edce-4367-b5a5-ed02400c4526 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:41.057829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50667f4-edce-4367-b5a5-ed02400c4526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:41.059499 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50667f4-edce-4367-b5a5-ed02400c4526 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:41.066757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 357/715] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Aug 18 16:51:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:41.088238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b3616e17-6d42-4a21-a5df-ddda798a9cdb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:41.089586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b3616e17-6d42-4a21-a5df-ddda798a9cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:41.185546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 359/716] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:41.461726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50667f4-edce-4367-b5a5-ed02400c4526 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:41.588014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50667f4-edce-4367-b5a5-ed02400c4526 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:41.633191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7093f81-45f8-49dd-a1a9-0d161d456628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:41.633854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093f81-45f8-49dd-a1a9-0d161d456628 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:41.634139 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093f81-45f8-49dd-a1a9-0d161d456628 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:41.634418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093f81-45f8-49dd-a1a9-0d161d456628 None admin] PATH_INFO: `/v3/services/network` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:41.635084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7093f81-45f8-49dd-a1a9-0d161d456628 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:41.636483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7093f81-45f8-49dd-a1a9-0d161d456628 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f7093f81-45f8-49dd-a1a9-0d161d456628 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:41.646533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:41.647601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:41.649092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 358/717] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:41 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:41.653710 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3616e17-6d42-4a21-a5df-ddda798a9cdb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:41.740097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:41.775986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3616e17-6d42-4a21-a5df-ddda798a9cdb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:41.831274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af389f-b0d6-4d3b-8efe-78b8061c9ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:41.831887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af389f-b0d6-4d3b-8efe-78b8061c9ffd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:41.832166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af389f-b0d6-4d3b-8efe-78b8061c9ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:41.832437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af389f-b0d6-4d3b-8efe-78b8061c9ffd None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:41.833088 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af389f-b0d6-4d3b-8efe-78b8061c9ffd None admin] RBAC: Adding query filter params (name=network) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:41.833392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af389f-b0d6-4d3b-8efe-78b8061c9ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:41.834818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af389f-b0d6-4d3b-8efe-78b8061c9ffd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:41.839687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 360/718] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:51:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:41.845010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7093f81-45f8-49dd-a1a9-0d161d456628 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:41.905069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:41.986592 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7093f81-45f8-49dd-a1a9-0d161d456628 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:42.035783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ef4cb-21f6-4894-ba03-31d441bce9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:42.036323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ef4cb-21f6-4894-ba03-31d441bce9ed None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:42.036651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ef4cb-21f6-4894-ba03-31d441bce9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:42.036931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ef4cb-21f6-4894-ba03-31d441bce9ed None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:42.037575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ef4cb-21f6-4894-ba03-31d441bce9ed None admin] RBAC: Adding query filter params (type=network) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:42.037883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ef4cb-21f6-4894-ba03-31d441bce9ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:42.039260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ef4cb-21f6-4894-ba03-31d441bce9ed None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:42.048519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 359/719] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:51:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:42.294291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4fb3-effe-403c-a509-f28ed1dc95f9 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:42.294484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4fb3-effe-403c-a509-f28ed1dc95f9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:42.294771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4fb3-effe-403c-a509-f28ed1dc95f9 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:42.296549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 361/720] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:42.302376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883cd6c-6b4d-470d-8606-7156fb57afa1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:42.302678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883cd6c-6b4d-470d-8606-7156fb57afa1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:42.302942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883cd6c-6b4d-470d-8606-7156fb57afa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:42.322989 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5883cd6c-6b4d-470d-8606-7156fb57afa1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:42.324205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5883cd6c-6b4d-470d-8606-7156fb57afa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:42.412972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 360/721] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:42.824996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a4fb3-effe-403c-a509-f28ed1dc95f9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:42.957191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a4fb3-effe-403c-a509-f28ed1dc95f9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:42.998178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:43.010863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefeb05-2972-4cab-b7d7-16a1622acec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:43.011523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefeb05-2972-4cab-b7d7-16a1622acec3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.011809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefeb05-2972-4cab-b7d7-16a1622acec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.012154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefeb05-2972-4cab-b7d7-16a1622acec3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.028323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefeb05-2972-4cab-b7d7-16a1622acec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-dbefeb05-2972-4cab-b7d7-16a1622acec3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:43.033186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:43.034158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:43.035029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 362/722] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:43.040239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883cd6c-6b4d-470d-8606-7156fb57afa1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:43.086668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:43.167168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883cd6c-6b4d-470d-8606-7156fb57afa1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:43.212867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c7e8b-2f8e-4b68-9e9d-4fe3710ab340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:43.213489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c7e8b-2f8e-4b68-9e9d-4fe3710ab340 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.213768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c7e8b-2f8e-4b68-9e9d-4fe3710ab340 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.214044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c7e8b-2f8e-4b68-9e9d-4fe3710ab340 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.214716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c7e8b-2f8e-4b68-9e9d-4fe3710ab340 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:43.215024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c7e8b-2f8e-4b68-9e9d-4fe3710ab340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:43.216400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c7e8b-2f8e-4b68-9e9d-4fe3710ab340 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:43.225532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 361/723] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:43.230854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefeb05-2972-4cab-b7d7-16a1622acec3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:43.368245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefeb05-2972-4cab-b7d7-16a1622acec3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:43.415989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd997a86-711f-4af8-9429-17f0c89f7bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:43.416675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd997a86-711f-4af8-9429-17f0c89f7bea None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.416960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd997a86-711f-4af8-9429-17f0c89f7bea None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.417236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd997a86-711f-4af8-9429-17f0c89f7bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.428776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd997a86-711f-4af8-9429-17f0c89f7bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:43.433618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd997a86-711f-4af8-9429-17f0c89f7bea None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:43.437158 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484acd0-2699-4b1d-a8f1-9ef6c6e3ac6c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.437738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484acd0-2699-4b1d-a8f1-9ef6c6e3ac6c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.438266 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484acd0-2699-4b1d-a8f1-9ef6c6e3ac6c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.439804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 362/724] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:51:43.445332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720fa02-f043-4718-b157-f8de6de33c84 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.445939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720fa02-f043-4718-b157-f8de6de33c84 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.446640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720fa02-f043-4718-b157-f8de6de33c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-dd997a86-711f-4af8-9429-17f0c89f7bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:43.449301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:43.450328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:43.456115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:43.456115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:43.456115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:43.456115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 363/725] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:43.458112 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd997a86-711f-4af8-9429-17f0c89f7bea None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:43.473704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7720fa02-f043-4718-b157-f8de6de33c84 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:43.475239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7720fa02-f043-4718-b157-f8de6de33c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:43.536879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:43.572720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 363/726] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 16:51:43.574550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45cb87-7d06-46e2-b45f-3fafb63a402b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.574758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45cb87-7d06-46e2-b45f-3fafb63a402b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.576414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45cb87-7d06-46e2-b45f-3fafb63a402b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.579763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 364/727] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:43.587024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8d95-5ff1-43b9-8c7d-f44fa67c0f12 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.587313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8d95-5ff1-43b9-8c7d-f44fa67c0f12 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.588539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa8d95-5ff1-43b9-8c7d-f44fa67c0f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.594928 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd997a86-711f-4af8-9429-17f0c89f7bea None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:43.620327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-93aa8d95-5ff1-43b9-8c7d-f44fa67c0f12 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:43.621489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-93aa8d95-5ff1-43b9-8c7d-f44fa67c0f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:43.658661 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:43.660804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510a43c-27e6-4f02-b173-9e6b615cb1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:43.661460 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a43c-27e6-4f02-b173-9e6b615cb1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.661746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a43c-27e6-4f02-b173-9e6b615cb1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.662025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a43c-27e6-4f02-b173-9e6b615cb1f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.662677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510a43c-27e6-4f02-b173-9e6b615cb1f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:43.662985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510a43c-27e6-4f02-b173-9e6b615cb1f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:43.664363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510a43c-27e6-4f02-b173-9e6b615cb1f6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:43.684042 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 364/728] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:43.685685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db288-5f4b-4e48-8007-9bf5f1326179 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.686167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db288-5f4b-4e48-8007-9bf5f1326179 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.686654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db288-5f4b-4e48-8007-9bf5f1326179 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.689030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 365/729] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:43.690132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db288-5f4b-4e48-8007-9bf5f1326179 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:43.732804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 365/730] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:43.734158 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05e3d-1f45-43ec-bc16-7d0d5015d95c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.734463 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05e3d-1f45-43ec-bc16-7d0d5015d95c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.734734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05e3d-1f45-43ec-bc16-7d0d5015d95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.767419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-97e05e3d-1f45-43ec-bc16-7d0d5015d95c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:43.768649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-97e05e3d-1f45-43ec-bc16-7d0d5015d95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:43.878895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db288-5f4b-4e48-8007-9bf5f1326179 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:43.881907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 366/731] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:43.884819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e05e3d-1f45-43ec-bc16-7d0d5015d95c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:43.897468 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:43.965629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b40be-bbbb-4f48-a178-7615f0c6fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:43.968710 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b40be-bbbb-4f48-a178-7615f0c6fca0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:43.969011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b40be-bbbb-4f48-a178-7615f0c6fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:43.969289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b40be-bbbb-4f48-a178-7615f0c6fca0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:43.987179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b40be-bbbb-4f48-a178-7615f0c6fca0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:43.988668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b40be-bbbb-4f48-a178-7615f0c6fca0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-2c4b40be-bbbb-4f48-a178-7615f0c6fca0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:44.014039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:44.015107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:44.016139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 366/732] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:44.021223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b40be-bbbb-4f48-a178-7615f0c6fca0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:44.024978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:44.042129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e05e3d-1f45-43ec-bc16-7d0d5015d95c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:44.087030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d876d-7cbd-4b45-aefd-e0eaf3c2dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:44.087922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d876d-7cbd-4b45-aefd-e0eaf3c2dcf1 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:44.088206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d876d-7cbd-4b45-aefd-e0eaf3c2dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:44.088500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d876d-7cbd-4b45-aefd-e0eaf3c2dcf1 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:44.089905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d876d-7cbd-4b45-aefd-e0eaf3c2dcf1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:44.091336 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d876d-7cbd-4b45-aefd-e0eaf3c2dcf1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:44.113948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 367/733] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:51:43 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:51:44.115072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d876d-7cbd-4b45-aefd-e0eaf3c2dcf1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:44.246548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b40be-bbbb-4f48-a178-7615f0c6fca0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:44.306261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2debd0-c1ef-4d4d-88b8-1afae1bc7f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:44.306261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2debd0-c1ef-4d4d-88b8-1afae1bc7f53 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:44.306261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2debd0-c1ef-4d4d-88b8-1afae1bc7f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:44.306261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2debd0-c1ef-4d4d-88b8-1afae1bc7f53 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:44.307022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2debd0-c1ef-4d4d-88b8-1afae1bc7f53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:44.308594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2debd0-c1ef-4d4d-88b8-1afae1bc7f53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:44.309929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2debd0-c1ef-4d4d-88b8-1afae1bc7f53 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:44.330410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 367/734] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Aug 18 16:51:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:44.331342 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2debd0-c1ef-4d4d-88b8-1afae1bc7f53 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:44.354447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:44.364808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d876d-7cbd-4b45-aefd-e0eaf3c2dcf1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:44.404891 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030bd55-4ff0-4aac-a402-035893b97fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:44.405929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030bd55-4ff0-4aac-a402-035893b97fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:44.406409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030bd55-4ff0-4aac-a402-035893b97fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:44.406917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030bd55-4ff0-4aac-a402-035893b97fa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:44.420568 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030bd55-4ff0-4aac-a402-035893b97fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0030bd55-4ff0-4aac-a402-035893b97fa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:44.426508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:44.427554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:44.428450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:44.431576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 368/735] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:44.433397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030bd55-4ff0-4aac-a402-035893b97fa0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:44.443984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:44.548432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030bd55-4ff0-4aac-a402-035893b97fa0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:44.560310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2debd0-c1ef-4d4d-88b8-1afae1bc7f53 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:44.584313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d55491-1646-40e8-89ca-d38282eeb09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:44.585197 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d55491-1646-40e8-89ca-d38282eeb09c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:44.585645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d55491-1646-40e8-89ca-d38282eeb09c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:44.585923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d55491-1646-40e8-89ca-d38282eeb09c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:44.595265 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77729798-9ef2-482e-918a-695865e5c767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:44.595895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729798-9ef2-482e-918a-695865e5c767 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:44.596175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729798-9ef2-482e-918a-695865e5c767 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:44.596439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729798-9ef2-482e-918a-695865e5c767 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:44.607170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77729798-9ef2-482e-918a-695865e5c767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-77729798-9ef2-482e-918a-695865e5c767 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:44.612370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:44.613527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:44.614773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 368/736] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:44.615485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77729798-9ef2-482e-918a-695865e5c767 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:44.661964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d55491-1646-40e8-89ca-d38282eeb09c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:44.663702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d55491-1646-40e8-89ca-d38282eeb09c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:44.671484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:44.704279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:44.729594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77729798-9ef2-482e-918a-695865e5c767 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:44.767900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca565e-2bae-4921-afcb-dcc82522e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:44.768662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca565e-2bae-4921-afcb-dcc82522e443 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:44.769013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca565e-2bae-4921-afcb-dcc82522e443 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:44.769369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca565e-2bae-4921-afcb-dcc82522e443 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:44.770102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca565e-2bae-4921-afcb-dcc82522e443 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:44.770478 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca565e-2bae-4921-afcb-dcc82522e443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:44.771936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca565e-2bae-4921-afcb-dcc82522e443 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:44.780224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 369/737] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 16:51:44.780594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 369/738] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:44.781431 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca565e-2bae-4921-afcb-dcc82522e443 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:44.789941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602158c-70d0-4b18-a05a-bde23cc2e7fd None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:44.790735 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602158c-70d0-4b18-a05a-bde23cc2e7fd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:44.791019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602158c-70d0-4b18-a05a-bde23cc2e7fd None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:44.792852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 370/739] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:44.795106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602158c-70d0-4b18-a05a-bde23cc2e7fd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:44.891002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca565e-2bae-4921-afcb-dcc82522e443 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:44.909194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602158c-70d0-4b18-a05a-bde23cc2e7fd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:44.917143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:44.929881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af697c-68ef-4edf-872a-0875dafa2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:44.930743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af697c-68ef-4edf-872a-0875dafa2d3c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:44.931208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af697c-68ef-4edf-872a-0875dafa2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:44.931661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af697c-68ef-4edf-872a-0875dafa2d3c None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:44.933091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af697c-68ef-4edf-872a-0875dafa2d3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:44.933818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af697c-68ef-4edf-872a-0875dafa2d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:44.936088 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af697c-68ef-4edf-872a-0875dafa2d3c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:44.946217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142f11f-d38f-4ea9-a560-025254d7a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:44.946878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f11f-d38f-4ea9-a560-025254d7a104 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:44.947160 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f11f-d38f-4ea9-a560-025254d7a104 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:44.947438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f11f-d38f-4ea9-a560-025254d7a104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:44.948244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 370/740] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:44.949260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af697c-68ef-4edf-872a-0875dafa2d3c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:44.952870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:44.959601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142f11f-d38f-4ea9-a560-025254d7a104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:44.961366 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142f11f-d38f-4ea9-a560-025254d7a104 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7142f11f-d38f-4ea9-a560-025254d7a104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:44.978573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:44.979590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:44.980524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:44.980524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:44.980524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:44.980524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 371/741] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:44.981189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353081-e140-49cf-8379-fbbcb1d32042 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:44.981189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353081-e140-49cf-8379-fbbcb1d32042 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:44.981498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353081-e140-49cf-8379-fbbcb1d32042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:45.001206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-59353081-e140-49cf-8379-fbbcb1d32042 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:45.002441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-59353081-e140-49cf-8379-fbbcb1d32042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:45.075045 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af697c-68ef-4edf-872a-0875dafa2d3c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:45.082774 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 372/742] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 16:51:45.084592 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59353081-e140-49cf-8379-fbbcb1d32042 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:45.109961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88582ff1-afd3-46c3-b591-05c0942d1874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:45.110601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88582ff1-afd3-46c3-b591-05c0942d1874 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:45.110878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88582ff1-afd3-46c3-b591-05c0942d1874 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:45.111154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88582ff1-afd3-46c3-b591-05c0942d1874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:45.122726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88582ff1-afd3-46c3-b591-05c0942d1874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:45.124279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88582ff1-afd3-46c3-b591-05c0942d1874 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-88582ff1-afd3-46c3-b591-05c0942d1874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:45.140297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:45.142126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:45.143168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:45.143168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:45.143168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:45.146829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 371/743] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:45.147695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88582ff1-afd3-46c3-b591-05c0942d1874 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:45.206008 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:45.218384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:45.225051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59353081-e140-49cf-8379-fbbcb1d32042 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:45.265264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845cd8-4252-4f44-9a7a-2db3208248cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:45.266715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845cd8-4252-4f44-9a7a-2db3208248cc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:45.267146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845cd8-4252-4f44-9a7a-2db3208248cc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:45.267663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845cd8-4252-4f44-9a7a-2db3208248cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:45.278497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88582ff1-afd3-46c3-b591-05c0942d1874 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:45.279126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf845cd8-4252-4f44-9a7a-2db3208248cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:45.280978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf845cd8-4252-4f44-9a7a-2db3208248cc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-cf845cd8-4252-4f44-9a7a-2db3208248cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:45.297610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:45.298821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:45.299871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:45.299871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:45.299871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:45.301898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 373/744] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:45.302964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845cd8-4252-4f44-9a7a-2db3208248cc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:45.325292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae746229-7672-4f74-ae6c-be55f94dcac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:45.326246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae746229-7672-4f74-ae6c-be55f94dcac3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:45.326674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae746229-7672-4f74-ae6c-be55f94dcac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:45.327090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae746229-7672-4f74-ae6c-be55f94dcac3 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:45.327896 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae746229-7672-4f74-ae6c-be55f94dcac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:45.328474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae746229-7672-4f74-ae6c-be55f94dcac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:45.330622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae746229-7672-4f74-ae6c-be55f94dcac3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:45.345273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 372/745] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:45.346411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae746229-7672-4f74-ae6c-be55f94dcac3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:45.417892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845cd8-4252-4f44-9a7a-2db3208248cc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:45.452712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d2cf-9f5e-403e-b662-a3ea0586ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:45.453386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d2cf-9f5e-403e-b662-a3ea0586ade2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:45.453706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d2cf-9f5e-403e-b662-a3ea0586ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:45.453975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d2cf-9f5e-403e-b662-a3ea0586ade2 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:45.454682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64d2cf-9f5e-403e-b662-a3ea0586ade2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:45.454999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64d2cf-9f5e-403e-b662-a3ea0586ade2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:45.456373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64d2cf-9f5e-403e-b662-a3ea0586ade2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:45.457251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae746229-7672-4f74-ae6c-be55f94dcac3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:45.465514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:45.472316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:45.473954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 374/746] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:45.474806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d2cf-9f5e-403e-b662-a3ea0586ade2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:45.498093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aa1e4-e440-4cbf-96dd-1da870a240cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:45.498708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aa1e4-e440-4cbf-96dd-1da870a240cb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:45.499134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aa1e4-e440-4cbf-96dd-1da870a240cb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:45.499407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aa1e4-e440-4cbf-96dd-1da870a240cb None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:45.500053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aa1e4-e440-4cbf-96dd-1da870a240cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:45.500603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aa1e4-e440-4cbf-96dd-1da870a240cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:45.501824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aa1e4-e440-4cbf-96dd-1da870a240cb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:45.513589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 373/747] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:45.519376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aa1e4-e440-4cbf-96dd-1da870a240cb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:45.585824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d2cf-9f5e-403e-b662-a3ea0586ade2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:45.620452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f220661-0574-4431-943d-49450fc6cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:45.621107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f220661-0574-4431-943d-49450fc6cee5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:45.621385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f220661-0574-4431-943d-49450fc6cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:45.621655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f220661-0574-4431-943d-49450fc6cee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:45.627348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aa1e4-e440-4cbf-96dd-1da870a240cb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:45.628927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f220661-0574-4431-943d-49450fc6cee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:45.630359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f220661-0574-4431-943d-49450fc6cee5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8f220661-0574-4431-943d-49450fc6cee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:45.641416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:45.642385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:45.643317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:45.643317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:45.643317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:45.643317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:45.643317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:45.643317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:45.643317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:45.643317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:45.643317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 375/748] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:45.643317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f220661-0574-4431-943d-49450fc6cee5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:45.670241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b052794-83e8-4543-813a-7e57f2f37504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:45.671171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052794-83e8-4543-813a-7e57f2f37504 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:45.671641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052794-83e8-4543-813a-7e57f2f37504 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:45.672165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052794-83e8-4543-813a-7e57f2f37504 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:45.673177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b052794-83e8-4543-813a-7e57f2f37504 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:45.674836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b052794-83e8-4543-813a-7e57f2f37504 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:45.692507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 374/749] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:51:45 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:51:45.693854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b052794-83e8-4543-813a-7e57f2f37504 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:45.714992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:45.772298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:45.790330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f220661-0574-4431-943d-49450fc6cee5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:45.840299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef9ea6-ebf1-43e8-9de4-d7cfc169ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:45.840567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef9ea6-ebf1-43e8-9de4-d7cfc169ef1b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:45.840751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef9ea6-ebf1-43e8-9de4-d7cfc169ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:45.841035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef9ea6-ebf1-43e8-9de4-d7cfc169ef1b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:45.852428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef9ea6-ebf1-43e8-9de4-d7cfc169ef1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:45.854035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef9ea6-ebf1-43e8-9de4-d7cfc169ef1b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:45.865209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b052794-83e8-4543-813a-7e57f2f37504 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a5ef9ea6-ebf1-43e8-9de4-d7cfc169ef1b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:45.868741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:45.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 376/750] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Aug 18 16:51:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:45.871039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef9ea6-ebf1-43e8-9de4-d7cfc169ef1b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:45.912846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfa8df-c01d-46f5-9da8-a5673fc5baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:45.912846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfa8df-c01d-46f5-9da8-a5673fc5baad None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:45.912846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfa8df-c01d-46f5-9da8-a5673fc5baad None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:45.912846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfa8df-c01d-46f5-9da8-a5673fc5baad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:45.922413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfa8df-c01d-46f5-9da8-a5673fc5baad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:45.924683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfa8df-c01d-46f5-9da8-a5673fc5baad None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-93dfa8df-c01d-46f5-9da8-a5673fc5baad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:45.938178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:45.939394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:45.940612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:45.940612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:45.940612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:45.940612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:45.940612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:45.940612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:45.940612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:45.940612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:45.940612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:45.940612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:45.941847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 375/751] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Aug 18 16:51:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:45.946474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfa8df-c01d-46f5-9da8-a5673fc5baad None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:46.004963 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef9ea6-ebf1-43e8-9de4-d7cfc169ef1b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:46.031436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:46.066152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d40208-9f04-4918-9e77-024d39d32e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:46.066786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d40208-9f04-4918-9e77-024d39d32e66 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:46.067070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d40208-9f04-4918-9e77-024d39d32e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:46.067349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d40208-9f04-4918-9e77-024d39d32e66 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:46.068332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d40208-9f04-4918-9e77-024d39d32e66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:46.068695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d40208-9f04-4918-9e77-024d39d32e66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:46.070980 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d40208-9f04-4918-9e77-024d39d32e66 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:46.072344 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:46.081916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfa8df-c01d-46f5-9da8-a5673fc5baad None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:46.092551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 377/752] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:46.094104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d40208-9f04-4918-9e77-024d39d32e66 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:46.136544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055e69-db73-4c01-8909-32c827de0f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:46.137302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055e69-db73-4c01-8909-32c827de0f9a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:46.137588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055e69-db73-4c01-8909-32c827de0f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:46.137873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055e69-db73-4c01-8909-32c827de0f9a None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:46.138676 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0055e69-db73-4c01-8909-32c827de0f9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:46.138990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0055e69-db73-4c01-8909-32c827de0f9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:46.142235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0055e69-db73-4c01-8909-32c827de0f9a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:46.162782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 376/753] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Aug 18 16:51:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:46.163744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055e69-db73-4c01-8909-32c827de0f9a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:46.219369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d40208-9f04-4918-9e77-024d39d32e66 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:46.258544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772885e9-d97b-4d13-943c-935a9ac014b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:46.259159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772885e9-d97b-4d13-943c-935a9ac014b0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:46.259439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772885e9-d97b-4d13-943c-935a9ac014b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:46.259773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772885e9-d97b-4d13-943c-935a9ac014b0 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:46.260586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772885e9-d97b-4d13-943c-935a9ac014b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:46.260898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772885e9-d97b-4d13-943c-935a9ac014b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:46.262338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772885e9-d97b-4d13-943c-935a9ac014b0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:46.273353 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055e69-db73-4c01-8909-32c827de0f9a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:46.280561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 378/754] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Aug 18 16:51:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:46.282322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230f55f-c46e-41c0-aebb-1d63498dd2fe None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:46.282611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230f55f-c46e-41c0-aebb-1d63498dd2fe None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:46.283324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230f55f-c46e-41c0-aebb-1d63498dd2fe None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:46.288590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 379/755] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:46.289412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230f55f-c46e-41c0-aebb-1d63498dd2fe None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:46.314945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b85b7-7f8a-4597-8f22-77a319c35930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:46.315559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b85b7-7f8a-4597-8f22-77a319c35930 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:46.315843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b85b7-7f8a-4597-8f22-77a319c35930 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:46.316119 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b85b7-7f8a-4597-8f22-77a319c35930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:46.316868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b85b7-7f8a-4597-8f22-77a319c35930 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=4ee382ab3c8945f1b39b14b00d9237ba) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:46.317179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b85b7-7f8a-4597-8f22-77a319c35930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:46.318592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b85b7-7f8a-4597-8f22-77a319c35930 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:46.324052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 377/756] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:46 2022] GET /identity/v3/role_assignments?user.id=4ee382ab3c8945f1b39b14b00d9237ba&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=56228137a4444ef9b7e688d04abd00fd => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:46.324897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b85b7-7f8a-4597-8f22-77a319c35930 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:46.341772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:46.354049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:46.445065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230f55f-c46e-41c0-aebb-1d63498dd2fe None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:46.453422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b85b7-7f8a-4597-8f22-77a319c35930 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:46.485484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28cf62-5617-459c-a69a-d0faaab02b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:46.486766 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28cf62-5617-459c-a69a-d0faaab02b93 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:46.486766 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28cf62-5617-459c-a69a-d0faaab02b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:46.486766 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28cf62-5617-459c-a69a-d0faaab02b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:46.492597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb089e10-ef5b-4336-8210-c635a7e5296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:46.493237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089e10-ef5b-4336-8210-c635a7e5296a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:46.493517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089e10-ef5b-4336-8210-c635a7e5296a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:46.493790 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089e10-ef5b-4336-8210-c635a7e5296a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:46.505611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb089e10-ef5b-4336-8210-c635a7e5296a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:46.507055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb089e10-ef5b-4336-8210-c635a7e5296a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-eb089e10-ef5b-4336-8210-c635a7e5296a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:46.526081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:46.527229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:46.528179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:46.528179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:46.528179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:46.532540 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 378/757] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:46.533939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2e1b5-4ca5-4d68-8565-51281ae60f06 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:46.534225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2e1b5-4ca5-4d68-8565-51281ae60f06 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:46.534503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2e1b5-4ca5-4d68-8565-51281ae60f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:46.553594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4db2e1b5-4ca5-4d68-8565-51281ae60f06 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:46.554953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4db2e1b5-4ca5-4d68-8565-51281ae60f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:46.567062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28cf62-5617-459c-a69a-d0faaab02b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:46.569214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28cf62-5617-459c-a69a-d0faaab02b93 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:46.605292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:46.636419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:46.642302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 379/758] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:51:46.643222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2e1b5-4ca5-4d68-8565-51281ae60f06 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:46.684277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 380/759] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:51:46.689527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28cf62-5617-459c-a69a-d0faaab02b93 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:46.863067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2e1b5-4ca5-4d68-8565-51281ae60f06 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:46.894781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28cf62-5617-459c-a69a-d0faaab02b93 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:46.900531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425746b-2e7a-48e3-a02c-54f6d6215717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:46.901229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425746b-2e7a-48e3-a02c-54f6d6215717 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:46.901582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425746b-2e7a-48e3-a02c-54f6d6215717 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:46.901929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425746b-2e7a-48e3-a02c-54f6d6215717 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:46.902644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425746b-2e7a-48e3-a02c-54f6d6215717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:46.903020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425746b-2e7a-48e3-a02c-54f6d6215717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:46.904517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425746b-2e7a-48e3-a02c-54f6d6215717 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:46.920828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 380/760] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:46.921807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425746b-2e7a-48e3-a02c-54f6d6215717 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:46.951317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d293e-9083-4ef0-bef3-741dccbb12ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:46.952391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d293e-9083-4ef0-bef3-741dccbb12ed None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:46.952895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d293e-9083-4ef0-bef3-741dccbb12ed None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:46.953355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d293e-9083-4ef0-bef3-741dccbb12ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:46.955663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:46.965990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d293e-9083-4ef0-bef3-741dccbb12ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:46.967890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d293e-9083-4ef0-bef3-741dccbb12ed None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:46.983250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d32d293e-9083-4ef0-bef3-741dccbb12ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:46.988242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:46.989669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:46.990709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:46.990709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:46.990709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:46.997474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 381/761] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:46.998596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d293e-9083-4ef0-bef3-741dccbb12ed None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:47.027035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425746b-2e7a-48e3-a02c-54f6d6215717 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:47.062061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53acf80-9297-495c-9dad-c928caf2c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:47.062697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53acf80-9297-495c-9dad-c928caf2c0ca None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:47.063524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53acf80-9297-495c-9dad-c928caf2c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:47.063806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53acf80-9297-495c-9dad-c928caf2c0ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:47.064401 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53acf80-9297-495c-9dad-c928caf2c0ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:47.065922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53acf80-9297-495c-9dad-c928caf2c0ca None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e53acf80-9297-495c-9dad-c928caf2c0ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:47.078704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:47.085940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:47.086808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 381/762] 10.222.0.81 () {56 vars in 1129 bytes} [Thu Aug 18 16:51:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:47.087626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53acf80-9297-495c-9dad-c928caf2c0ca None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:47.145442 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d293e-9083-4ef0-bef3-741dccbb12ed None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:47.201043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f92996-27f7-42a9-8b78-241ea2d071c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:47.202131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f92996-27f7-42a9-8b78-241ea2d071c8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:47.202746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f92996-27f7-42a9-8b78-241ea2d071c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:47.203241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f92996-27f7-42a9-8b78-241ea2d071c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:47.215832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f92996-27f7-42a9-8b78-241ea2d071c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:47.218831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f92996-27f7-42a9-8b78-241ea2d071c8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:47.237052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53acf80-9297-495c-9dad-c928caf2c0ca None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-07f92996-27f7-42a9-8b78-241ea2d071c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:47.240770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:47.241894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:47.242940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:47.242940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:47.242940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:47.242940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:47.242940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:47.242940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:47.242940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:47.242940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:47.244537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 382/763] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:47.245575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f92996-27f7-42a9-8b78-241ea2d071c8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:47.273423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:47.286815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492dc0-d785-4d72-bbe7-fcd6b773678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:47.287430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492dc0-d785-4d72-bbe7-fcd6b773678d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:47.287763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492dc0-d785-4d72-bbe7-fcd6b773678d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:47.288047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492dc0-d785-4d72-bbe7-fcd6b773678d None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:47.288802 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be492dc0-d785-4d72-bbe7-fcd6b773678d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:47.289109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be492dc0-d785-4d72-bbe7-fcd6b773678d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:47.290482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be492dc0-d785-4d72-bbe7-fcd6b773678d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:47.307557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 382/764] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:47.308549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492dc0-d785-4d72-bbe7-fcd6b773678d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:47.316767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:47.386242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f92996-27f7-42a9-8b78-241ea2d071c8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:47.433147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba33ff5-4171-4fa7-962f-30b515ac8f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:47.433982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba33ff5-4171-4fa7-962f-30b515ac8f56 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:47.434441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba33ff5-4171-4fa7-962f-30b515ac8f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:47.434745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba33ff5-4171-4fa7-962f-30b515ac8f56 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:47.435537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba33ff5-4171-4fa7-962f-30b515ac8f56 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:47.435944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba33ff5-4171-4fa7-962f-30b515ac8f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:47.437889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba33ff5-4171-4fa7-962f-30b515ac8f56 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:47.446669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 383/765] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Aug 18 16:51:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:47.446669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba33ff5-4171-4fa7-962f-30b515ac8f56 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:47.470551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492dc0-d785-4d72-bbe7-fcd6b773678d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:47.516821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179da19-3b01-4e07-83bb-222794f10d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:47.517780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179da19-3b01-4e07-83bb-222794f10d2b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:47.518236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179da19-3b01-4e07-83bb-222794f10d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:47.518657 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179da19-3b01-4e07-83bb-222794f10d2b None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:47.519486 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179da19-3b01-4e07-83bb-222794f10d2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:47.520093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179da19-3b01-4e07-83bb-222794f10d2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:47.522176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179da19-3b01-4e07-83bb-222794f10d2b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:47.540009 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 383/766] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:47.541352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179da19-3b01-4e07-83bb-222794f10d2b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:47.565968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba33ff5-4171-4fa7-962f-30b515ac8f56 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:47.582856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:47.601325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:47.622376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84afe66-5ae8-45fc-bb08-0c525d6b80e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:47.624069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84afe66-5ae8-45fc-bb08-0c525d6b80e6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:47.624614 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84afe66-5ae8-45fc-bb08-0c525d6b80e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:47.625318 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84afe66-5ae8-45fc-bb08-0c525d6b80e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:47.636414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84afe66-5ae8-45fc-bb08-0c525d6b80e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:47.639019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84afe66-5ae8-45fc-bb08-0c525d6b80e6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e84afe66-5ae8-45fc-bb08-0c525d6b80e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:47.658121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:47.659118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:47.660259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:47.660259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:47.660259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:47.660259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:47.660259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:47.660259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:47.660259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:47.660259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:47.660259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 384/767] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:47.660259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84afe66-5ae8-45fc-bb08-0c525d6b80e6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:47.670652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179da19-3b01-4e07-83bb-222794f10d2b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:47.707842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273509f-a91a-46b8-9a17-fc5af2f1b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:47.708506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273509f-a91a-46b8-9a17-fc5af2f1b089 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:47.708779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273509f-a91a-46b8-9a17-fc5af2f1b089 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:47.709053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273509f-a91a-46b8-9a17-fc5af2f1b089 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:47.709780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273509f-a91a-46b8-9a17-fc5af2f1b089 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:47.710091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273509f-a91a-46b8-9a17-fc5af2f1b089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:47.711448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273509f-a91a-46b8-9a17-fc5af2f1b089 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:47.718427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 384/768] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Aug 18 16:51:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:47.719304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273509f-a91a-46b8-9a17-fc5af2f1b089 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:47.778395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84afe66-5ae8-45fc-bb08-0c525d6b80e6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:47.815812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143002c-d088-4cbb-afcf-7b006101ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:47.816402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143002c-d088-4cbb-afcf-7b006101ddbf None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:47.816718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143002c-d088-4cbb-afcf-7b006101ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:47.816998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143002c-d088-4cbb-afcf-7b006101ddbf None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/c425b390c8dc4d799270fdd095be78b4/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:47.818957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143002c-d088-4cbb-afcf-7b006101ddbf None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=c425b390c8dc4d799270fdd095be78b4, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:47.820399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143002c-d088-4cbb-afcf-7b006101ddbf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:47.829687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273509f-a91a-46b8-9a17-fc5af2f1b089 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:47.845163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 385/769] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:51:47 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/c425b390c8dc4d799270fdd095be78b4/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:51:47.845163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143002c-d088-4cbb-afcf-7b006101ddbf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:47.845972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:47.900363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd630b-6fe1-4734-9d3f-62410fb5290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:47.901537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd630b-6fe1-4734-9d3f-62410fb5290f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:47.902423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd630b-6fe1-4734-9d3f-62410fb5290f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:47.902982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd630b-6fe1-4734-9d3f-62410fb5290f None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:47.905210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd630b-6fe1-4734-9d3f-62410fb5290f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:47.905861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd630b-6fe1-4734-9d3f-62410fb5290f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:47.907445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:47.910282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd630b-6fe1-4734-9d3f-62410fb5290f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:47.941385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 385/770] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:47.944395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120ff6a-8a7c-4bc5-a817-f8c0f8c97640 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:47.944872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120ff6a-8a7c-4bc5-a817-f8c0f8c97640 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:47.945785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120ff6a-8a7c-4bc5-a817-f8c0f8c97640 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:47.948593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 386/771] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:47.950452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120ff6a-8a7c-4bc5-a817-f8c0f8c97640 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:48.037048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143002c-d088-4cbb-afcf-7b006101ddbf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:48.075257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a595dfd-1a16-41e8-8045-59c748cc17b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:48.076705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a595dfd-1a16-41e8-8045-59c748cc17b0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:48.077259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a595dfd-1a16-41e8-8045-59c748cc17b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:48.077695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a595dfd-1a16-41e8-8045-59c748cc17b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:48.079268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a595dfd-1a16-41e8-8045-59c748cc17b0 None admin] RBAC: Adding query filter params (interface=public, service_id=d1b04d5dc58c4a62932d5ea1d6531c12, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:48.080045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a595dfd-1a16-41e8-8045-59c748cc17b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:48.081899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a595dfd-1a16-41e8-8045-59c748cc17b0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:48.091978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 386/772] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Aug 18 16:51:47 2022] GET /identity/v3/endpoints?service_id=d1b04d5dc58c4a62932d5ea1d6531c12&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:48.097706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67d6a-a022-4dd4-951b-f8a42a49568b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:48.098740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67d6a-a022-4dd4-951b-f8a42a49568b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:48.099183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67d6a-a022-4dd4-951b-f8a42a49568b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:48.122434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b1b67d6a-a022-4dd4-951b-f8a42a49568b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:48.124080 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b1b67d6a-a022-4dd4-951b-f8a42a49568b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:48.129943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120ff6a-8a7c-4bc5-a817-f8c0f8c97640 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:48.171349 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677db0c0-7693-4218-91da-4404d03d6294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:48.172115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677db0c0-7693-4218-91da-4404d03d6294 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:48.173139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677db0c0-7693-4218-91da-4404d03d6294 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:48.173504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677db0c0-7693-4218-91da-4404d03d6294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:48.174355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677db0c0-7693-4218-91da-4404d03d6294 None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=2b359b4974ab4d91895106a37d32fb6c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:48.174753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677db0c0-7693-4218-91da-4404d03d6294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:48.176267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677db0c0-7693-4218-91da-4404d03d6294 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:48.188494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 387/773] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:47 2022] GET /identity/v3/role_assignments?user.id=2b359b4974ab4d91895106a37d32fb6c&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:48.188494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677db0c0-7693-4218-91da-4404d03d6294 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:48.238259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 387/774] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:51:48.257028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:48.355564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677db0c0-7693-4218-91da-4404d03d6294 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:48.402762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca83bb-6781-471b-8108-12da28874d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:48.403411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca83bb-6781-471b-8108-12da28874d27 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:48.403698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca83bb-6781-471b-8108-12da28874d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:48.403980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca83bb-6781-471b-8108-12da28874d27 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:48.404640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca83bb-6781-471b-8108-12da28874d27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:48.406060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca83bb-6781-471b-8108-12da28874d27 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:48.412219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 388/775] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Aug 18 16:51:48 2022] GET /identity/v3/services => generated 772 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:48.460689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfca9d-3055-48da-9e3c-94356cb15482 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:48.461007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfca9d-3055-48da-9e3c-94356cb15482 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:48.461452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfca9d-3055-48da-9e3c-94356cb15482 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:48.463565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 388/776] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:48.469362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185a97-0236-4b63-a0c1-a77675d402f6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:48.469644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185a97-0236-4b63-a0c1-a77675d402f6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:48.469982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185a97-0236-4b63-a0c1-a77675d402f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:48.494105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e9185a97-0236-4b63-a0c1-a77675d402f6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:48.495332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e9185a97-0236-4b63-a0c1-a77675d402f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:48.537422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfca9d-3055-48da-9e3c-94356cb15482 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:48.580584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:48.589062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 389/777] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:51:48.667288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfca9d-3055-48da-9e3c-94356cb15482 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:48.704345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee9693-449b-48b9-a550-31f86b496695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:48.705013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee9693-449b-48b9-a550-31f86b496695 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:48.705297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee9693-449b-48b9-a550-31f86b496695 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:48.705579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee9693-449b-48b9-a550-31f86b496695 None admin] PATH_INFO: `/v3/services/network` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:48.706235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee9693-449b-48b9-a550-31f86b496695 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:48.707624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee9693-449b-48b9-a550-31f86b496695 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-67ee9693-449b-48b9-a550-31f86b496695 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:48.716660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:48.717694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:48.718731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 389/778] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:48 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:48.729672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9185a97-0236-4b63-a0c1-a77675d402f6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:48.759555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:48.838735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9185a97-0236-4b63-a0c1-a77675d402f6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:48.875200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14f52-f183-4470-a0fd-3a2ebf2863f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:48.876354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14f52-f183-4470-a0fd-3a2ebf2863f6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:48.876671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14f52-f183-4470-a0fd-3a2ebf2863f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:48.877181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14f52-f183-4470-a0fd-3a2ebf2863f6 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:48.877819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f14f52-f183-4470-a0fd-3a2ebf2863f6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:48.878125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f14f52-f183-4470-a0fd-3a2ebf2863f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:48.879597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f14f52-f183-4470-a0fd-3a2ebf2863f6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:48.884759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 390/779] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:51:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:48.888901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee9693-449b-48b9-a550-31f86b496695 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:48.895113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14f52-f183-4470-a0fd-3a2ebf2863f6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:48.997208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:49.006926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee9693-449b-48b9-a550-31f86b496695 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:49.044920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98dc85-50f4-414f-944a-d94ad493d0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:49.045672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98dc85-50f4-414f-944a-d94ad493d0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:49.046010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98dc85-50f4-414f-944a-d94ad493d0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:49.046291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98dc85-50f4-414f-944a-d94ad493d0b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:49.066327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98dc85-50f4-414f-944a-d94ad493d0b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-3b98dc85-50f4-414f-944a-d94ad493d0b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:49.074665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:49.076939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:49.079114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 390/780] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:49.083383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98dc85-50f4-414f-944a-d94ad493d0b2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:49.133145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:49.155111 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14f52-f183-4470-a0fd-3a2ebf2863f6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:49.222602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670633d-6464-4d9d-bb1b-5501ff41ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:49.223355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670633d-6464-4d9d-bb1b-5501ff41ba5e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:49.223636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670633d-6464-4d9d-bb1b-5501ff41ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:49.223914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670633d-6464-4d9d-bb1b-5501ff41ba5e None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:49.224613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670633d-6464-4d9d-bb1b-5501ff41ba5e None admin] RBAC: Adding query filter params (type=network) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:49.224923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670633d-6464-4d9d-bb1b-5501ff41ba5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:49.226439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670633d-6464-4d9d-bb1b-5501ff41ba5e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:49.237233 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98dc85-50f4-414f-944a-d94ad493d0b2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:49.241410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 391/781] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:51:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:49.247392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670633d-6464-4d9d-bb1b-5501ff41ba5e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:49.289393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca223d4-7fe1-4005-ab0b-2badbd4adeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:49.290097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca223d4-7fe1-4005-ab0b-2badbd4adeac None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:49.290288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca223d4-7fe1-4005-ab0b-2badbd4adeac None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:49.290565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca223d4-7fe1-4005-ab0b-2badbd4adeac None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:49.291240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca223d4-7fe1-4005-ab0b-2badbd4adeac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:49.291549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca223d4-7fe1-4005-ab0b-2badbd4adeac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:49.292946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca223d4-7fe1-4005-ab0b-2badbd4adeac None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:49.330712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 391/782] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:49.341467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca223d4-7fe1-4005-ab0b-2badbd4adeac None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:49.381072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:49.409873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670633d-6464-4d9d-bb1b-5501ff41ba5e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:49.494610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca223d4-7fe1-4005-ab0b-2badbd4adeac None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:49.500384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dce24-11ad-40d3-ba13-fca0ea1cce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:49.500982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dce24-11ad-40d3-ba13-fca0ea1cce8f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:49.501268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dce24-11ad-40d3-ba13-fca0ea1cce8f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:49.501554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dce24-11ad-40d3-ba13-fca0ea1cce8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:49.502338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dce24-11ad-40d3-ba13-fca0ea1cce8f None admin] RBAC: Adding query filter params (interface=public, service_id=ed7ce9cab2b247a2a50aa6a0e3ffde62, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:49.502659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dce24-11ad-40d3-ba13-fca0ea1cce8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:49.504094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dce24-11ad-40d3-ba13-fca0ea1cce8f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:49.520912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 392/783] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Aug 18 16:51:49 2022] GET /identity/v3/endpoints?service_id=ed7ce9cab2b247a2a50aa6a0e3ffde62&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:49.528226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dce24-11ad-40d3-ba13-fca0ea1cce8f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:49.539575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c559-f7fe-443a-8ad5-da442ead8755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:49.540472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c559-f7fe-443a-8ad5-da442ead8755 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:49.540906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c559-f7fe-443a-8ad5-da442ead8755 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:49.541330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8c559-f7fe-443a-8ad5-da442ead8755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:49.554606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c559-f7fe-443a-8ad5-da442ead8755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:49.556307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8c559-f7fe-443a-8ad5-da442ead8755 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:49.570124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e0c8c559-f7fe-443a-8ad5-da442ead8755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:49.572690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:49.573685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:49.574615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:49.574615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:49.574615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:49.574615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 392/784] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:49.579659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c559-f7fe-443a-8ad5-da442ead8755 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:49.654004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:49.716811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8c559-f7fe-443a-8ad5-da442ead8755 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:49.763506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3798f87-dab4-4f3d-bc39-1c8c713ad814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:49.764142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3798f87-dab4-4f3d-bc39-1c8c713ad814 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:49.764577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3798f87-dab4-4f3d-bc39-1c8c713ad814 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:49.764923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3798f87-dab4-4f3d-bc39-1c8c713ad814 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:49.765654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3798f87-dab4-4f3d-bc39-1c8c713ad814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:49.766637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3798f87-dab4-4f3d-bc39-1c8c713ad814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:49.768105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3798f87-dab4-4f3d-bc39-1c8c713ad814 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:49.781084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 393/785] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:49.786582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3798f87-dab4-4f3d-bc39-1c8c713ad814 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:49.834417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dce24-11ad-40d3-ba13-fca0ea1cce8f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:49.898553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3798f87-dab4-4f3d-bc39-1c8c713ad814 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:49.928909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:49.941396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270fe6-e6e0-4c15-9164-1ab0f536e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:49.942232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270fe6-e6e0-4c15-9164-1ab0f536e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:49.942619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270fe6-e6e0-4c15-9164-1ab0f536e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:49.944030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270fe6-e6e0-4c15-9164-1ab0f536e1c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:49.951821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94270fe6-e6e0-4c15-9164-1ab0f536e1c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:49.953982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94270fe6-e6e0-4c15-9164-1ab0f536e1c4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-94270fe6-e6e0-4c15-9164-1ab0f536e1c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:49.966380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:49.967589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:49.969288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:49.969288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:49.969288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:49.969288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:49.969288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:49.969288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:49.969288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:49.969288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:49.969288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:49.969288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:49.969874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 394/786] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:49.975678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270fe6-e6e0-4c15-9164-1ab0f536e1c4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:49.978104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773130e8-2fe0-4330-b072-ba20bb44dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:49.978748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773130e8-2fe0-4330-b072-ba20bb44dfaa None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:49.979034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773130e8-2fe0-4330-b072-ba20bb44dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:49.979314 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773130e8-2fe0-4330-b072-ba20bb44dfaa None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:49.979938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773130e8-2fe0-4330-b072-ba20bb44dfaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:49.981347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773130e8-2fe0-4330-b072-ba20bb44dfaa None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:50.007205 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 393/787] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Aug 18 16:51:49 2022] GET /identity/v3/services => generated 772 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:50.121164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270fe6-e6e0-4c15-9164-1ab0f536e1c4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:50.159365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53759d-41f7-4f17-a1e1-c0bf0ccf5530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:50.159992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53759d-41f7-4f17-a1e1-c0bf0ccf5530 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.160280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53759d-41f7-4f17-a1e1-c0bf0ccf5530 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.160586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53759d-41f7-4f17-a1e1-c0bf0ccf5530 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.161349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53759d-41f7-4f17-a1e1-c0bf0ccf5530 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:50.161665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53759d-41f7-4f17-a1e1-c0bf0ccf5530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:50.163147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53759d-41f7-4f17-a1e1-c0bf0ccf5530 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:50.178063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256decc-bb35-4794-a1cc-a38fedf35b1d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.178589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256decc-bb35-4794-a1cc-a38fedf35b1d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.178589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256decc-bb35-4794-a1cc-a38fedf35b1d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.181354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 394/788] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:50.183956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 395/789] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Aug 18 16:51:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:50.190097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f78a4-d4e3-48a4-94ad-dfcbca8d3280 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.190476 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f78a4-d4e3-48a4-94ad-dfcbca8d3280 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.190579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53759d-41f7-4f17-a1e1-c0bf0ccf5530 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:50.190659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f78a4-d4e3-48a4-94ad-dfcbca8d3280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.227393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2e7f78a4-d4e3-48a4-94ad-dfcbca8d3280 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:50.228912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2e7f78a4-d4e3-48a4-94ad-dfcbca8d3280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:50.244837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:50.320792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53759d-41f7-4f17-a1e1-c0bf0ccf5530 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:50.347164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 395/790] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:51:50.358633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cc058-ea62-4096-a6ae-7d79bb86987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:50.359285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cc058-ea62-4096-a6ae-7d79bb86987b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.359568 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cc058-ea62-4096-a6ae-7d79bb86987b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.360482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cc058-ea62-4096-a6ae-7d79bb86987b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.372027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cc058-ea62-4096-a6ae-7d79bb86987b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:50.373469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cc058-ea62-4096-a6ae-7d79bb86987b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2e6cc058-ea62-4096-a6ae-7d79bb86987b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:50.389339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:50.390337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:50.391842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:50.391842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:50.391842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:50.391842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 396/791] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:50.396728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f78a4-d4e3-48a4-94ad-dfcbca8d3280 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:50.410096 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:50.503620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f78a4-d4e3-48a4-94ad-dfcbca8d3280 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:50.539076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e2cec-b44b-40ed-9d05-6206aac3117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:50.539701 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e2cec-b44b-40ed-9d05-6206aac3117b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.539980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e2cec-b44b-40ed-9d05-6206aac3117b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.540263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e2cec-b44b-40ed-9d05-6206aac3117b None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.540967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e2cec-b44b-40ed-9d05-6206aac3117b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:50.541422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e2cec-b44b-40ed-9d05-6206aac3117b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:50.542683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e2cec-b44b-40ed-9d05-6206aac3117b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:50.555701 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 396/792] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:50.561279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cc058-ea62-4096-a6ae-7d79bb86987b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:50.661783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:50.671409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cc058-ea62-4096-a6ae-7d79bb86987b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:50.708209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4036e3d-344f-42c0-8888-90efbfe942c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:50.708868 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036e3d-344f-42c0-8888-90efbfe942c6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.709150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036e3d-344f-42c0-8888-90efbfe942c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.709425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036e3d-344f-42c0-8888-90efbfe942c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.717281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e2cec-b44b-40ed-9d05-6206aac3117b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:50.718575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4036e3d-344f-42c0-8888-90efbfe942c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:50.720121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4036e3d-344f-42c0-8888-90efbfe942c6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b4036e3d-344f-42c0-8888-90efbfe942c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:50.736484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:50.737431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:50.738338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:50.738338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:50.738338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:50.738338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:50.738338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:50.738338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:50.738338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:50.738338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:50.738338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 397/793] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:50.741625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4036e3d-344f-42c0-8888-90efbfe942c6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:50.843892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:50.862726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4036e3d-344f-42c0-8888-90efbfe942c6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:50.882931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e2cec-b44b-40ed-9d05-6206aac3117b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:50.905238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8150a50-6137-4e71-9749-83364a0171b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:50.905860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150a50-6137-4e71-9749-83364a0171b4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.906143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150a50-6137-4e71-9749-83364a0171b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.906418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150a50-6137-4e71-9749-83364a0171b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.907985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8150a50-6137-4e71-9749-83364a0171b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:50.908299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8150a50-6137-4e71-9749-83364a0171b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:50.909788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8150a50-6137-4e71-9749-83364a0171b4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:50.923910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 398/794] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:50.929546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0f8c5-03af-4820-a489-1b10b33afa67 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.929900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0f8c5-03af-4820-a489-1b10b33afa67 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.930098 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0f8c5-03af-4820-a489-1b10b33afa67 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.931511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 399/795] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:50.932393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a97111-ddd7-4e13-8e86-59ea81bc3d5d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.932711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a97111-ddd7-4e13-8e86-59ea81bc3d5d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.932996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a97111-ddd7-4e13-8e86-59ea81bc3d5d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.934252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 400/796] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:50.937414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a97111-ddd7-4e13-8e86-59ea81bc3d5d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:50.937749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c375017-d360-46af-81bd-80228c573ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:50.938901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c375017-d360-46af-81bd-80228c573ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.939208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c375017-d360-46af-81bd-80228c573ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.939559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c375017-d360-46af-81bd-80228c573ec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.952145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c375017-d360-46af-81bd-80228c573ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:50.953507 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-6c375017-d360-46af-81bd-80228c573ec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:50.960639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:50.961609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:50.962470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 397/797] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:50.963627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2334327-3b00-454f-9abc-446c762e7b57 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:50.963969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2334327-3b00-454f-9abc-446c762e7b57 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:50.964393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2334327-3b00-454f-9abc-446c762e7b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:50.986430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a2334327-3b00-454f-9abc-446c762e7b57 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:50.988595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a2334327-3b00-454f-9abc-446c762e7b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:51.054508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a97111-ddd7-4e13-8e86-59ea81bc3d5d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:51.074271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 398/798] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:51:51.085811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c67cd-a797-4c94-bd33-5c00ada36021 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:51.086096 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c67cd-a797-4c94-bd33-5c00ada36021 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:51.086772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c67cd-a797-4c94-bd33-5c00ada36021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:51.091333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55501bea-8f61-4ab6-a1cd-72941bc2f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:51.091999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55501bea-8f61-4ab6-a1cd-72941bc2f663 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:51.092278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55501bea-8f61-4ab6-a1cd-72941bc2f663 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:51.092584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55501bea-8f61-4ab6-a1cd-72941bc2f663 None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/4ee382ab3c8945f1b39b14b00d9237ba/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:51.095137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55501bea-8f61-4ab6-a1cd-72941bc2f663 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=4ee382ab3c8945f1b39b14b00d9237ba, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:51.096645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55501bea-8f61-4ab6-a1cd-72941bc2f663 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:51.117634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-250c67cd-a797-4c94-bd33-5c00ada36021 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:51.119319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-250c67cd-a797-4c94-bd33-5c00ada36021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:51.124552 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 401/799] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:51:50 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/4ee382ab3c8945f1b39b14b00d9237ba/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:51:51.125876 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55501bea-8f61-4ab6-a1cd-72941bc2f663 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:51.242624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:51.271757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 399/800] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:51:51.274612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:51.309843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55501bea-8f61-4ab6-a1cd-72941bc2f663 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:51.345965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b29d3-5a67-4b16-a5ba-854a6eeca0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:51.346646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b29d3-5a67-4b16-a5ba-854a6eeca0ca None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:51.346856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b29d3-5a67-4b16-a5ba-854a6eeca0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:51.347124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b29d3-5a67-4b16-a5ba-854a6eeca0ca None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:51.347799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b29d3-5a67-4b16-a5ba-854a6eeca0ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:51.348104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b29d3-5a67-4b16-a5ba-854a6eeca0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:51.349511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b29d3-5a67-4b16-a5ba-854a6eeca0ca None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:51.358590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 402/801] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:51.364268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c67cd-a797-4c94-bd33-5c00ada36021 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:51.429227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b29d3-5a67-4b16-a5ba-854a6eeca0ca None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:51.497082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c67cd-a797-4c94-bd33-5c00ada36021 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:51.568927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4c235-7140-4873-ae46-4da5f7086ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:51.569581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4c235-7140-4873-ae46-4da5f7086ffc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:51.569867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4c235-7140-4873-ae46-4da5f7086ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:51.570146 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4c235-7140-4873-ae46-4da5f7086ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:51.589662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4c235-7140-4873-ae46-4da5f7086ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:51.591485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4c235-7140-4873-ae46-4da5f7086ffc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:51.601665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b29d3-5a67-4b16-a5ba-854a6eeca0ca None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9fd4c235-7140-4873-ae46-4da5f7086ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:51.609856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:51.610914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:51.611823 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:51.611823 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:51.611823 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:51.613931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 400/802] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:51.623887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4c235-7140-4873-ae46-4da5f7086ffc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:51.662111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5c117-b1d1-40ee-ab5c-8b588b642f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:51.662770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5c117-b1d1-40ee-ab5c-8b588b642f5f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:51.663091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5c117-b1d1-40ee-ab5c-8b588b642f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:51.663375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5c117-b1d1-40ee-ab5c-8b588b642f5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:51.665598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:51.675693 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:51.678333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5c117-b1d1-40ee-ab5c-8b588b642f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-daf5c117-b1d1-40ee-ab5c-8b588b642f5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:51.684253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:51.685295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:51.686151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:51.691154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 403/803] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:51.691822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5c117-b1d1-40ee-ab5c-8b588b642f5f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:51.746215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4c235-7140-4873-ae46-4da5f7086ffc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:51.784719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06462209-0e2e-4bb3-97a0-2170bb27c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:51.785700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06462209-0e2e-4bb3-97a0-2170bb27c0af None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:51.786191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06462209-0e2e-4bb3-97a0-2170bb27c0af None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:51.786680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06462209-0e2e-4bb3-97a0-2170bb27c0af None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:51.787628 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06462209-0e2e-4bb3-97a0-2170bb27c0af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:51.788130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06462209-0e2e-4bb3-97a0-2170bb27c0af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:51.789749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06462209-0e2e-4bb3-97a0-2170bb27c0af None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:51.800865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5c117-b1d1-40ee-ab5c-8b588b642f5f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:51.804565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 401/804] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:51.805661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06462209-0e2e-4bb3-97a0-2170bb27c0af None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:51.837253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baa212-002a-46b5-9f87-f3acea38b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:51.837958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baa212-002a-46b5-9f87-f3acea38b38c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:51.838240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baa212-002a-46b5-9f87-f3acea38b38c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:51.838518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baa212-002a-46b5-9f87-f3acea38b38c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:51.839176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baa212-002a-46b5-9f87-f3acea38b38c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:51.840498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baa212-002a-46b5-9f87-f3acea38b38c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-c6baa212-002a-46b5-9f87-f3acea38b38c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:51.850283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:51.851329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 16:51:51.852194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:51.856252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 404/805] 10.222.0.81 () {56 vars in 1129 bytes} [Thu Aug 18 16:51:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:51.857259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baa212-002a-46b5-9f87-f3acea38b38c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:51.921200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06462209-0e2e-4bb3-97a0-2170bb27c0af None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:51.921834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:51.925912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:51.964125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65b0d7-c2fe-4ff2-92fa-3d5afabafad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:51.965191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65b0d7-c2fe-4ff2-92fa-3d5afabafad6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:51.965674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65b0d7-c2fe-4ff2-92fa-3d5afabafad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:51.966162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65b0d7-c2fe-4ff2-92fa-3d5afabafad6 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:51.967019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65b0d7-c2fe-4ff2-92fa-3d5afabafad6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:51.967518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65b0d7-c2fe-4ff2-92fa-3d5afabafad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:51.967624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baa212-002a-46b5-9f87-f3acea38b38c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:51.969852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65b0d7-c2fe-4ff2-92fa-3d5afabafad6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:51.979607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 402/806] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:51.980776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65b0d7-c2fe-4ff2-92fa-3d5afabafad6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:52.008653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2390be-ae23-4a89-a847-c378965091de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:52.009293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2390be-ae23-4a89-a847-c378965091de None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.009693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2390be-ae23-4a89-a847-c378965091de None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.009974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2390be-ae23-4a89-a847-c378965091de None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:52.018631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2390be-ae23-4a89-a847-c378965091de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:52.020173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2390be-ae23-4a89-a847-c378965091de None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-aa2390be-ae23-4a89-a847-c378965091de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:52.032417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:52.033474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:52.034448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 405/807] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Aug 18 16:51:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:52.035106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2390be-ae23-4a89-a847-c378965091de None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:52.112763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65b0d7-c2fe-4ff2-92fa-3d5afabafad6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:52.149850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b596a81-a3f3-423e-9ca2-f05493ddb6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:52.150842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b596a81-a3f3-423e-9ca2-f05493ddb6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.151322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b596a81-a3f3-423e-9ca2-f05493ddb6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.151786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b596a81-a3f3-423e-9ca2-f05493ddb6d8 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:52.152668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b596a81-a3f3-423e-9ca2-f05493ddb6d8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:52.153170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b596a81-a3f3-423e-9ca2-f05493ddb6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:52.154751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b596a81-a3f3-423e-9ca2-f05493ddb6d8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:52.160541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 403/808] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Aug 18 16:51:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:52.161733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b596a81-a3f3-423e-9ca2-f05493ddb6d8 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:52.169058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2390be-ae23-4a89-a847-c378965091de None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:52.191791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:52.194279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:52.215328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77359d0d-1b40-44cf-be0a-2267c6d57dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:52.216366 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77359d0d-1b40-44cf-be0a-2267c6d57dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.216876 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77359d0d-1b40-44cf-be0a-2267c6d57dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.217347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77359d0d-1b40-44cf-be0a-2267c6d57dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:52.230302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77359d0d-1b40-44cf-be0a-2267c6d57dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:52.232226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77359d0d-1b40-44cf-be0a-2267c6d57dc7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-77359d0d-1b40-44cf-be0a-2267c6d57dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:52.249096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:52.250087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:52.251164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:52.251164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:52.251164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:52.253468 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 406/809] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:52.254585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77359d0d-1b40-44cf-be0a-2267c6d57dc7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:52.281674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b596a81-a3f3-423e-9ca2-f05493ddb6d8 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:52.327074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289a873-b303-4434-8bcf-bafa2dc5ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:52.327706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a873-b303-4434-8bcf-bafa2dc5ca13 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.327988 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a873-b303-4434-8bcf-bafa2dc5ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.328260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289a873-b303-4434-8bcf-bafa2dc5ca13 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:52.329598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289a873-b303-4434-8bcf-bafa2dc5ca13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:52.329905 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289a873-b303-4434-8bcf-bafa2dc5ca13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:52.331469 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289a873-b303-4434-8bcf-bafa2dc5ca13 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:52.355016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 404/810] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Aug 18 16:51:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:52.355016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289a873-b303-4434-8bcf-bafa2dc5ca13 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:52.370960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77359d0d-1b40-44cf-be0a-2267c6d57dc7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:52.417902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da79059-8707-45c4-89e0-6c1ea4e3088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:52.418518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79059-8707-45c4-89e0-6c1ea4e3088d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.418962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79059-8707-45c4-89e0-6c1ea4e3088d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.419239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79059-8707-45c4-89e0-6c1ea4e3088d None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:52.420207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da79059-8707-45c4-89e0-6c1ea4e3088d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:52.420788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da79059-8707-45c4-89e0-6c1ea4e3088d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:52.422774 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da79059-8707-45c4-89e0-6c1ea4e3088d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:52.430462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 407/811] 10.222.0.81 () {56 vars in 1124 bytes} [Thu Aug 18 16:51:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:52.432596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affeb73-6ca2-4fb4-90dc-5e71f08550f7 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.433030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affeb73-6ca2-4fb4-90dc-5e71f08550f7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.433412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affeb73-6ca2-4fb4-90dc-5e71f08550f7 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:52.435262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 408/812] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:52.436061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affeb73-6ca2-4fb4-90dc-5e71f08550f7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:52.455680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:52.474047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289a873-b303-4434-8bcf-bafa2dc5ca13 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:52.477076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:52.514809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760330-dd26-484b-9a91-e8b16ecf03d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:52.516542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760330-dd26-484b-9a91-e8b16ecf03d3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.516542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760330-dd26-484b-9a91-e8b16ecf03d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.516542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760330-dd26-484b-9a91-e8b16ecf03d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:52.517212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6760330-dd26-484b-9a91-e8b16ecf03d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:52.517521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6760330-dd26-484b-9a91-e8b16ecf03d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:52.518902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6760330-dd26-484b-9a91-e8b16ecf03d3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:52.535920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 405/813] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:52.535920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760330-dd26-484b-9a91-e8b16ecf03d3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:52.555319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affeb73-6ca2-4fb4-90dc-5e71f08550f7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:52.594097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb9d12-33ea-4175-98db-10fcbe16164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:52.594632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb9d12-33ea-4175-98db-10fcbe16164a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.594911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb9d12-33ea-4175-98db-10fcbe16164a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.595183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb9d12-33ea-4175-98db-10fcbe16164a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:52.652644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760330-dd26-484b-9a91-e8b16ecf03d3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:52.674866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb9d12-33ea-4175-98db-10fcbe16164a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:52.676344 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb9d12-33ea-4175-98db-10fcbe16164a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:52.697388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d194d-c69a-40f9-8276-9e566e8fbe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:52.698015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d194d-c69a-40f9-8276-9e566e8fbe71 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.698300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d194d-c69a-40f9-8276-9e566e8fbe71 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.699038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d194d-c69a-40f9-8276-9e566e8fbe71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:52.699996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d194d-c69a-40f9-8276-9e566e8fbe71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:52.701591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d194d-c69a-40f9-8276-9e566e8fbe71 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:52.711501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:52.740857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 406/814] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 16:51:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:51:52.742337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99f6e1-a4d6-4ce4-b60d-f39d2e5fe805 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.742860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99f6e1-a4d6-4ce4-b60d-f39d2e5fe805 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.742977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99f6e1-a4d6-4ce4-b60d-f39d2e5fe805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:52.763858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:52.780794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3d99f6e1-a4d6-4ce4-b60d-f39d2e5fe805 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:52.782264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3d99f6e1-a4d6-4ce4-b60d-f39d2e5fe805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:52.816135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 409/815] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:51:52.817054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb9d12-33ea-4175-98db-10fcbe16164a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:52.909907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 407/816] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:51:52.910811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99f6e1-a4d6-4ce4-b60d-f39d2e5fe805 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:52.951119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb9d12-33ea-4175-98db-10fcbe16164a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:52.998189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f807e33-0948-4d0d-9cf2-2f56ffe73214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:52.999106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f807e33-0948-4d0d-9cf2-2f56ffe73214 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:52.999415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f807e33-0948-4d0d-9cf2-2f56ffe73214 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:52.999699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f807e33-0948-4d0d-9cf2-2f56ffe73214 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.002982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:53.011638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f807e33-0948-4d0d-9cf2-2f56ffe73214 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:53.014475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f807e33-0948-4d0d-9cf2-2f56ffe73214 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1f807e33-0948-4d0d-9cf2-2f56ffe73214 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:53.033243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:53.034277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:53.039992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 410/817] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Aug 18 16:51:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:53.043642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f807e33-0948-4d0d-9cf2-2f56ffe73214 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:53.097644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99f6e1-a4d6-4ce4-b60d-f39d2e5fe805 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:53.150163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:53.159315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08063026-f23a-4c93-8933-20a3029c7937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:53.160397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08063026-f23a-4c93-8933-20a3029c7937 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:53.160912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08063026-f23a-4c93-8933-20a3029c7937 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:53.161504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08063026-f23a-4c93-8933-20a3029c7937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.173201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08063026-f23a-4c93-8933-20a3029c7937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:53.175098 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08063026-f23a-4c93-8933-20a3029c7937 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-08063026-f23a-4c93-8933-20a3029c7937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:53.191961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:53.193008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:53.193927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:53.193927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:53.193927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:53.196184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 408/818] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:53.210582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08063026-f23a-4c93-8933-20a3029c7937 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:53.251895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f807e33-0948-4d0d-9cf2-2f56ffe73214 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:53.296038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fa5aa-3d07-4d5d-8555-4c72a4d3aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:53.296763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fa5aa-3d07-4d5d-8555-4c72a4d3aa59 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:53.296943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fa5aa-3d07-4d5d-8555-4c72a4d3aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:53.297251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fa5aa-3d07-4d5d-8555-4c72a4d3aa59 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.297997 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fa5aa-3d07-4d5d-8555-4c72a4d3aa59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:53.298316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fa5aa-3d07-4d5d-8555-4c72a4d3aa59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:53.299746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fa5aa-3d07-4d5d-8555-4c72a4d3aa59 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:53.318532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 411/819] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Aug 18 16:51:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:53.323628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fa5aa-3d07-4d5d-8555-4c72a4d3aa59 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:53.327542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08063026-f23a-4c93-8933-20a3029c7937 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:53.368598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43580089-04b9-4767-842a-bf31b18d9fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:53.369578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43580089-04b9-4767-842a-bf31b18d9fda None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:53.370062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43580089-04b9-4767-842a-bf31b18d9fda None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:53.370559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43580089-04b9-4767-842a-bf31b18d9fda None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.371457 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43580089-04b9-4767-842a-bf31b18d9fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:53.371770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43580089-04b9-4767-842a-bf31b18d9fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:53.373316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43580089-04b9-4767-842a-bf31b18d9fda None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:53.387422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 409/820] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:53.387895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:53.390094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43580089-04b9-4767-842a-bf31b18d9fda None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:53.441275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:53.445528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fa5aa-3d07-4d5d-8555-4c72a4d3aa59 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:53.484178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c09ff0-3a7f-48bc-bb5c-e2b8bfd3779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:53.484928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09ff0-3a7f-48bc-bb5c-e2b8bfd3779b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:53.485255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09ff0-3a7f-48bc-bb5c-e2b8bfd3779b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:53.485480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09ff0-3a7f-48bc-bb5c-e2b8bfd3779b None admin] PATH_INFO: `/v3/services/network` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.486403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c09ff0-3a7f-48bc-bb5c-e2b8bfd3779b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:53.487799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c09ff0-3a7f-48bc-bb5c-e2b8bfd3779b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-33c09ff0-3a7f-48bc-bb5c-e2b8bfd3779b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:53.497303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:53.498678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:53.499539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 412/821] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:53 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:53.500439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c09ff0-3a7f-48bc-bb5c-e2b8bfd3779b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:53.520014 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43580089-04b9-4767-842a-bf31b18d9fda None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:53.559759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d1842-cb78-450f-867d-adf8f6ad7ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:53.560395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d1842-cb78-450f-867d-adf8f6ad7ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:53.560701 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d1842-cb78-450f-867d-adf8f6ad7ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:53.560979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d1842-cb78-450f-867d-adf8f6ad7ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.571785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d1842-cb78-450f-867d-adf8f6ad7ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:53.573312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d1842-cb78-450f-867d-adf8f6ad7ea9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e42d1842-cb78-450f-867d-adf8f6ad7ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:53.589268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:53.590329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:53.591482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:53.591482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:53.591482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:53.591482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 410/822] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:53.591758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7984f-8e84-492d-8dd4-32d28685f91e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:53.591836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7984f-8e84-492d-8dd4-32d28685f91e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:53.592382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7984f-8e84-492d-8dd4-32d28685f91e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.593603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 411/823] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:53.597441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7984f-8e84-492d-8dd4-32d28685f91e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:53.637002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c09ff0-3a7f-48bc-bb5c-e2b8bfd3779b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:53.658062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:53.679611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3283900-1d9d-4c8b-a029-0feec4bbb54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:53.680265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3283900-1d9d-4c8b-a029-0feec4bbb54e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:53.680599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3283900-1d9d-4c8b-a029-0feec4bbb54e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:53.680856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3283900-1d9d-4c8b-a029-0feec4bbb54e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.688447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3283900-1d9d-4c8b-a029-0feec4bbb54e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:53.689915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3283900-1d9d-4c8b-a029-0feec4bbb54e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e3283900-1d9d-4c8b-a029-0feec4bbb54e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:53.701916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:53.702862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:53.704339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:53.704339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:53.704339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:53.704339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:53.704339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:53.704339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:53.704339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:53.704339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:53.704339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 413/824] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:53.704339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3283900-1d9d-4c8b-a029-0feec4bbb54e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:53.710669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:53.726615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7984f-8e84-492d-8dd4-32d28685f91e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:53.770533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cc449-8b31-4e59-9cb8-611044af9075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:53.771128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cc449-8b31-4e59-9cb8-611044af9075 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:53.771396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cc449-8b31-4e59-9cb8-611044af9075 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:53.771729 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cc449-8b31-4e59-9cb8-611044af9075 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.772300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cc449-8b31-4e59-9cb8-611044af9075 None admin] RBAC: Adding query filter params (name=network) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:53.772632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cc449-8b31-4e59-9cb8-611044af9075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:53.774078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cc449-8b31-4e59-9cb8-611044af9075 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:53.784538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 412/825] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:51:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:53.784538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf64ff2-ab61-434e-9c07-51994462d103 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:53.784538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf64ff2-ab61-434e-9c07-51994462d103 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:53.784538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf64ff2-ab61-434e-9c07-51994462d103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.799397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2cf64ff2-ab61-434e-9c07-51994462d103 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:53.800598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2cf64ff2-ab61-434e-9c07-51994462d103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:53.824091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3283900-1d9d-4c8b-a029-0feec4bbb54e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:53.860947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92a6d3-5618-40c6-ada0-ad4c12cdab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:53.861633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92a6d3-5618-40c6-ada0-ad4c12cdab7d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:53.861921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92a6d3-5618-40c6-ada0-ad4c12cdab7d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:53.862275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92a6d3-5618-40c6-ada0-ad4c12cdab7d None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:53.862973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92a6d3-5618-40c6-ada0-ad4c12cdab7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:53.863471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92a6d3-5618-40c6-ada0-ad4c12cdab7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:53.865401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92a6d3-5618-40c6-ada0-ad4c12cdab7d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:53.880000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 414/826] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:53.880870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92a6d3-5618-40c6-ada0-ad4c12cdab7d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:53.886909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 413/827] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:51:53.888041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf64ff2-ab61-434e-9c07-51994462d103 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:53.957090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:54.009013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:54.032947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf64ff2-ab61-434e-9c07-51994462d103 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:54.034552 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92a6d3-5618-40c6-ada0-ad4c12cdab7d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:54.079209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ebffe-08f6-4a52-8f50-7d7214064442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:54.079855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa7edf-d278-415a-a84b-d181946d5378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:54.079979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ebffe-08f6-4a52-8f50-7d7214064442 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.080167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ebffe-08f6-4a52-8f50-7d7214064442 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.080500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ebffe-08f6-4a52-8f50-7d7214064442 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.081197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7edf-d278-415a-a84b-d181946d5378 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.081302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ebffe-08f6-4a52-8f50-7d7214064442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:54.081571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ebffe-08f6-4a52-8f50-7d7214064442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:54.081971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7edf-d278-415a-a84b-d181946d5378 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.082517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7edf-d278-415a-a84b-d181946d5378 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.083064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ebffe-08f6-4a52-8f50-7d7214064442 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:54.083567 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa7edf-d278-415a-a84b-d181946d5378 None admin] RBAC: Adding query filter params (type=network) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:54.084085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa7edf-d278-415a-a84b-d181946d5378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:54.086684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa7edf-d278-415a-a84b-d181946d5378 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:54.098175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 415/828] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:54.098175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ebffe-08f6-4a52-8f50-7d7214064442 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:54.098998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 414/829] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:51:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:54.100258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa7edf-d278-415a-a84b-d181946d5378 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:54.213303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:54.214774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa7edf-d278-415a-a84b-d181946d5378 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:54.220089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ebffe-08f6-4a52-8f50-7d7214064442 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:54.253967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be23c02-516d-4a92-856e-9d7c71947c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:54.254725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be23c02-516d-4a92-856e-9d7c71947c52 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.255020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be23c02-516d-4a92-856e-9d7c71947c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.255299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be23c02-516d-4a92-856e-9d7c71947c52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.255959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be23c02-516d-4a92-856e-9d7c71947c52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:54.256402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd13ef5-37b8-4a6a-bfc7-cd14b79af8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:54.257077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd13ef5-37b8-4a6a-bfc7-cd14b79af8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.257359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd13ef5-37b8-4a6a-bfc7-cd14b79af8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.257468 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be23c02-516d-4a92-856e-9d7c71947c52 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:54.257627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd13ef5-37b8-4a6a-bfc7-cd14b79af8b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.264548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd13ef5-37b8-4a6a-bfc7-cd14b79af8b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:54.266006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd13ef5-37b8-4a6a-bfc7-cd14b79af8b3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:54.280389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 415/830] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 16:51:54 2022] POST /identity/v3/endpoints => generated 337 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-acd13ef5-37b8-4a6a-bfc7-cd14b79af8b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:54.280641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:54.281493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:54.282528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:54.282528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:54.282528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:54.282528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:54.282528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:54.282528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:54.282528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:54.282528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:54.284549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be23c02-516d-4a92-856e-9d7c71947c52 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:54.286496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 416/831] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:54.287498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd13ef5-37b8-4a6a-bfc7-cd14b79af8b3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:54.302064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:54.435771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd13ef5-37b8-4a6a-bfc7-cd14b79af8b3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:54.446919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be23c02-516d-4a92-856e-9d7c71947c52 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:54.492927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a6d7a-5d9b-4b73-9580-5f56b0119eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:54.494478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a6d7a-5d9b-4b73-9580-5f56b0119eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.494928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a6d7a-5d9b-4b73-9580-5f56b0119eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.495359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a6d7a-5d9b-4b73-9580-5f56b0119eb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.500154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913af93-46ed-4339-9f39-4bcec680246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:54.501464 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913af93-46ed-4339-9f39-4bcec680246a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.501741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913af93-46ed-4339-9f39-4bcec680246a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.502007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913af93-46ed-4339-9f39-4bcec680246a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.502748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913af93-46ed-4339-9f39-4bcec680246a None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=c425b390c8dc4d799270fdd095be78b4) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:54.503093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913af93-46ed-4339-9f39-4bcec680246a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:54.504542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913af93-46ed-4339-9f39-4bcec680246a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:54.511034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a6d7a-5d9b-4b73-9580-5f56b0119eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:54.511620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 416/832] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:54 2022] GET /identity/v3/role_assignments?user.id=c425b390c8dc4d799270fdd095be78b4&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=56228137a4444ef9b7e688d04abd00fd => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:54.512301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913af93-46ed-4339-9f39-4bcec680246a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0b0a6d7a-5d9b-4b73-9580-5f56b0119eb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:54.519055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:54.520047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:54.521303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 417/833] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:54.528523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a6d7a-5d9b-4b73-9580-5f56b0119eb8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:54.556368 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:54.620012 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:54.662557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913af93-46ed-4339-9f39-4bcec680246a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:54.689249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a6d7a-5d9b-4b73-9580-5f56b0119eb8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:54.703827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e0684-c3cd-4781-b74d-275cff936ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:54.705016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e0684-c3cd-4781-b74d-275cff936ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.705530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e0684-c3cd-4781-b74d-275cff936ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.706386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e0684-c3cd-4781-b74d-275cff936ec2 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.707179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e0684-c3cd-4781-b74d-275cff936ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:54.707817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e0684-c3cd-4781-b74d-275cff936ec2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:54.709367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e0684-c3cd-4781-b74d-275cff936ec2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:54.725076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 417/834] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:54.731376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e0684-c3cd-4781-b74d-275cff936ec2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:54.738728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0876b-c1f2-4018-a66c-ad083efb0e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:54.739836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0876b-c1f2-4018-a66c-ad083efb0e74 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.740263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0876b-c1f2-4018-a66c-ad083efb0e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.740751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0876b-c1f2-4018-a66c-ad083efb0e74 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.741655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0876b-c1f2-4018-a66c-ad083efb0e74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:54.742437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0876b-c1f2-4018-a66c-ad083efb0e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:54.743898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0876b-c1f2-4018-a66c-ad083efb0e74 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:54.755382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 418/835] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:54.761416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0876b-c1f2-4018-a66c-ad083efb0e74 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:54.848933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:54.871440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e0684-c3cd-4781-b74d-275cff936ec2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:54.872752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0876b-c1f2-4018-a66c-ad083efb0e74 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:54.901425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:54.913386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153ef09-5c24-40b9-9a78-2bb3b25b5be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:54.914053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153ef09-5c24-40b9-9a78-2bb3b25b5be1 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.914333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153ef09-5c24-40b9-9a78-2bb3b25b5be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.914607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153ef09-5c24-40b9-9a78-2bb3b25b5be1 None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/2b359b4974ab4d91895106a37d32fb6c/roles/b5bf9002fca54b179a5f07114e18fa07` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.916293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3547fc5-14f1-41fa-98c1-d6d827a70db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:54.916958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3547fc5-14f1-41fa-98c1-d6d827a70db2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.917238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3547fc5-14f1-41fa-98c1-d6d827a70db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.917511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3547fc5-14f1-41fa-98c1-d6d827a70db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.929131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3547fc5-14f1-41fa-98c1-d6d827a70db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:54.930587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3547fc5-14f1-41fa-98c1-d6d827a70db2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:54.932316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153ef09-5c24-40b9-9a78-2bb3b25b5be1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=2b359b4974ab4d91895106a37d32fb6c, role_id=b5bf9002fca54b179a5f07114e18fa07)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:54.934310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153ef09-5c24-40b9-9a78-2bb3b25b5be1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-e3547fc5-14f1-41fa-98c1-d6d827a70db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:54.946404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:54.947436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:54.948351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:54.948351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:54.948351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:54.948351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 419/836] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:54.949192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d08b4d-982c-4b01-8c38-8023243848f4 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.949192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d08b4d-982c-4b01-8c38-8023243848f4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.949435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d08b4d-982c-4b01-8c38-8023243848f4 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.950807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 420/837] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:54.956535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d08b4d-982c-4b01-8c38-8023243848f4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:54.964834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 418/838] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:51:54 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/2b359b4974ab4d91895106a37d32fb6c/roles/b5bf9002fca54b179a5f07114e18fa07 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:51:54.964834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a6083-36cc-46cb-85b0-d3da77c185ff None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:54.964834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a6083-36cc-46cb-85b0-d3da77c185ff None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:54.964834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a6083-36cc-46cb-85b0-d3da77c185ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:54.983591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-aa5a6083-36cc-46cb-85b0-d3da77c185ff None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:54.985825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-aa5a6083-36cc-46cb-85b0-d3da77c185ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:55.095383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d08b4d-982c-4b01-8c38-8023243848f4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:55.097868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 419/839] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:51:55.131511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:55.138395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7841bb6-8902-4b96-ab48-fc6aaaf12acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:55.139272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841bb6-8902-4b96-ab48-fc6aaaf12acd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:55.149680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841bb6-8902-4b96-ab48-fc6aaaf12acd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:55.149680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841bb6-8902-4b96-ab48-fc6aaaf12acd None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:55.149680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7841bb6-8902-4b96-ab48-fc6aaaf12acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:55.149680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7841bb6-8902-4b96-ab48-fc6aaaf12acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:55.149680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7841bb6-8902-4b96-ab48-fc6aaaf12acd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:55.157704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 421/840] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:55.163556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a6083-36cc-46cb-85b0-d3da77c185ff None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:55.275258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a6083-36cc-46cb-85b0-d3da77c185ff None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:55.284820 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:55.314189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d6774-fbaa-4581-af27-6bff06a29138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:55.314841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d6774-fbaa-4581-af27-6bff06a29138 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:55.315122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d6774-fbaa-4581-af27-6bff06a29138 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:55.315396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d6774-fbaa-4581-af27-6bff06a29138 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:55.324498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d6774-fbaa-4581-af27-6bff06a29138 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:55.325972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d6774-fbaa-4581-af27-6bff06a29138 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ce1d6774-fbaa-4581-af27-6bff06a29138 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:55.338951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:55.339983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:55.341005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 420/841] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:51:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:55.346060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7841bb6-8902-4b96-ab48-fc6aaaf12acd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:55.377428 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d6774-fbaa-4581-af27-6bff06a29138 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:55.467616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7841bb6-8902-4b96-ab48-fc6aaaf12acd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:55.505953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc3252-aae4-4dec-a925-5cbc0f335676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:55.506976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc3252-aae4-4dec-a925-5cbc0f335676 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:55.507464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc3252-aae4-4dec-a925-5cbc0f335676 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:55.507949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc3252-aae4-4dec-a925-5cbc0f335676 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:55.508969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc3252-aae4-4dec-a925-5cbc0f335676 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:55.509482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc3252-aae4-4dec-a925-5cbc0f335676 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:55.509883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d6774-fbaa-4581-af27-6bff06a29138 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:55.511703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc3252-aae4-4dec-a925-5cbc0f335676 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:55.530367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 422/842] 10.222.0.81 () {56 vars in 1135 bytes} [Thu Aug 18 16:51:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:55.538178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc3252-aae4-4dec-a925-5cbc0f335676 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:55.555277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67f1cd-20a0-4fcc-a3fa-b1c1574eb94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:55.556291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67f1cd-20a0-4fcc-a3fa-b1c1574eb94a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:55.556874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67f1cd-20a0-4fcc-a3fa-b1c1574eb94a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:55.557348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67f1cd-20a0-4fcc-a3fa-b1c1574eb94a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:55.558151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67f1cd-20a0-4fcc-a3fa-b1c1574eb94a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:55.559720 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67f1cd-20a0-4fcc-a3fa-b1c1574eb94a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4e67f1cd-20a0-4fcc-a3fa-b1c1574eb94a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:55.569184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:55.570254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:51:55.571104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:55.578381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 421/843] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:51:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:55.579966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67f1cd-20a0-4fcc-a3fa-b1c1574eb94a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:55.606225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:55.620831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:55.661137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc3252-aae4-4dec-a925-5cbc0f335676 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:55.693418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67f1cd-20a0-4fcc-a3fa-b1c1574eb94a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:55.703694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cd3fc-7735-44a6-8b1a-e545d4420dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:55.704324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd3fc-7735-44a6-8b1a-e545d4420dcf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:55.704629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd3fc-7735-44a6-8b1a-e545d4420dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:55.704902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd3fc-7735-44a6-8b1a-e545d4420dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:55.736417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56524425-4819-4813-bf1c-fe653b88ba33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:55.737487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524425-4819-4813-bf1c-fe653b88ba33 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:55.738105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524425-4819-4813-bf1c-fe653b88ba33 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:55.738633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524425-4819-4813-bf1c-fe653b88ba33 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:55.739816 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56524425-4819-4813-bf1c-fe653b88ba33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:55.740348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56524425-4819-4813-bf1c-fe653b88ba33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:55.742148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56524425-4819-4813-bf1c-fe653b88ba33 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:55.753487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 422/844] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:51:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:55.754952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56524425-4819-4813-bf1c-fe653b88ba33 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:55.792528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cd3fc-7735-44a6-8b1a-e545d4420dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:55.793991 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cd3fc-7735-44a6-8b1a-e545d4420dcf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:55.846405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:55.869732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:55.877238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56524425-4819-4813-bf1c-fe653b88ba33 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:55.914232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 423/845] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:51:55.915361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cd3fc-7735-44a6-8b1a-e545d4420dcf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:55.920810 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ebd66-3620-42c9-b6e7-8263968f1dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:55.921823 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ebd66-3620-42c9-b6e7-8263968f1dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:55.922339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ebd66-3620-42c9-b6e7-8263968f1dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:55.922828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ebd66-3620-42c9-b6e7-8263968f1dc5 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:55.924094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ebd66-3620-42c9-b6e7-8263968f1dc5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:55.924693 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ebd66-3620-42c9-b6e7-8263968f1dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:55.927370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ebd66-3620-42c9-b6e7-8263968f1dc5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:55.937005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 423/846] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:51:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:56.040025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cd3fc-7735-44a6-8b1a-e545d4420dcf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:56.078713 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cf892-40c6-490e-9564-1a45fea56947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:56.079367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cf892-40c6-490e-9564-1a45fea56947 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:56.079647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cf892-40c6-490e-9564-1a45fea56947 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:56.079920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cf892-40c6-490e-9564-1a45fea56947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:56.091795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cf892-40c6-490e-9564-1a45fea56947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:56.093312 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cf892-40c6-490e-9564-1a45fea56947 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:56.103852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b17cf892-40c6-490e-9564-1a45fea56947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:56.110761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:56.111798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:56.112758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:56.112758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:56.112758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:56.112758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 424/847] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:56.119138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ebd66-3620-42c9-b6e7-8263968f1dc5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:56.257135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ebd66-3620-42c9-b6e7-8263968f1dc5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:56.301319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe0804-a081-4b4b-9292-f2c56bedada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:56.302246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe0804-a081-4b4b-9292-f2c56bedada7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:56.302737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe0804-a081-4b4b-9292-f2c56bedada7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:56.303188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe0804-a081-4b4b-9292-f2c56bedada7 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:56.304017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe0804-a081-4b4b-9292-f2c56bedada7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:56.304528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe0804-a081-4b4b-9292-f2c56bedada7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:56.306077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe0804-a081-4b4b-9292-f2c56bedada7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:56.319552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 424/848] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:56.325485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cf892-40c6-490e-9564-1a45fea56947 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:56.454695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cf892-40c6-490e-9564-1a45fea56947 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:56.491167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc44d5-5cc3-47c8-8e44-07e1af841a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:56.492622 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc44d5-5cc3-47c8-8e44-07e1af841a23 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:56.493107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc44d5-5cc3-47c8-8e44-07e1af841a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:56.493556 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc44d5-5cc3-47c8-8e44-07e1af841a23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:56.501136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc44d5-5cc3-47c8-8e44-07e1af841a23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:56.502842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc44d5-5cc3-47c8-8e44-07e1af841a23 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-91dc44d5-5cc3-47c8-8e44-07e1af841a23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:56.514972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:56.516515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:56.517445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:56.517445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:56.517445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:56.517445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:56.517445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:56.517445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:56.517445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:56.517445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:56.519529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 425/849] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:56.525456 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe0804-a081-4b4b-9292-f2c56bedada7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:56.548643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:56.635227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe0804-a081-4b4b-9292-f2c56bedada7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:56.673516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c9422-4899-4118-997e-68541a4916a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:56.674438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c9422-4899-4118-997e-68541a4916a9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:56.674934 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c9422-4899-4118-997e-68541a4916a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:56.675411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c9422-4899-4118-997e-68541a4916a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:56.676285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c9422-4899-4118-997e-68541a4916a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:56.676785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c9422-4899-4118-997e-68541a4916a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:56.678526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c9422-4899-4118-997e-68541a4916a9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:56.692309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 425/850] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:56.701771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc44d5-5cc3-47c8-8e44-07e1af841a23 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:56.759272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b720f-4762-4aa4-8c4c-8d4d5b2a1d15 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:56.759566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b720f-4762-4aa4-8c4c-8d4d5b2a1d15 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:56.759853 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b720f-4762-4aa4-8c4c-8d4d5b2a1d15 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:56.761696 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 426/851] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:51:56.766911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f991-7c37-4d03-8bfd-de21931c481e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:56.767124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f991-7c37-4d03-8bfd-de21931c481e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:56.767407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f991-7c37-4d03-8bfd-de21931c481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:56.776874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:56.790799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a776f991-7c37-4d03-8bfd-de21931c481e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:56.792623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a776f991-7c37-4d03-8bfd-de21931c481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:56.821883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc44d5-5cc3-47c8-8e44-07e1af841a23 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:56.864313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657da017-dbd0-4479-822c-2e6255979e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:56.864964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657da017-dbd0-4479-822c-2e6255979e63 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:56.865244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657da017-dbd0-4479-822c-2e6255979e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:56.865520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657da017-dbd0-4479-822c-2e6255979e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:56.866534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657da017-dbd0-4479-822c-2e6255979e63 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=4ee382ab3c8945f1b39b14b00d9237ba) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:56.866848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657da017-dbd0-4479-822c-2e6255979e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:56.868866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657da017-dbd0-4479-822c-2e6255979e63 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:56.880573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 426/852] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:56 2022] GET /identity/v3/role_assignments?user.id=4ee382ab3c8945f1b39b14b00d9237ba&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=56228137a4444ef9b7e688d04abd00fd => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:56.886700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 427/853] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:51:57.045712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea0c4f-bd05-49f4-a598-31c7ed61b93d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:57.046057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea0c4f-bd05-49f4-a598-31c7ed61b93d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:57.046239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea0c4f-bd05-49f4-a598-31c7ed61b93d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:57.047860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 427/854] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:57.053372 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab3ea-ba58-4f2b-a27d-98a16aee7da4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:57.053662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab3ea-ba58-4f2b-a27d-98a16aee7da4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:57.054028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab3ea-ba58-4f2b-a27d-98a16aee7da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:57.073439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f67ab3ea-ba58-4f2b-a27d-98a16aee7da4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:57.074643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f67ab3ea-ba58-4f2b-a27d-98a16aee7da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:57.076824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:57.148310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 428/855] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:51:57.186405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea0c4f-bd05-49f4-a598-31c7ed61b93d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:57.303506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea0c4f-bd05-49f4-a598-31c7ed61b93d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:57.329644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:57.341191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eaa6e-4890-4944-9661-96f262316793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:57.341992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eaa6e-4890-4944-9661-96f262316793 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:57.342277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eaa6e-4890-4944-9661-96f262316793 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:57.342559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eaa6e-4890-4944-9661-96f262316793 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:57.343213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eaa6e-4890-4944-9661-96f262316793 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:57.344715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eaa6e-4890-4944-9661-96f262316793 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1f5eaa6e-4890-4944-9661-96f262316793 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:57.354506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:57.355711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:57.357274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 428/856] 10.222.0.81 () {56 vars in 1132 bytes} [Thu Aug 18 16:51:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:57.362591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ab3ea-ba58-4f2b-a27d-98a16aee7da4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:57.428546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eaa6e-4890-4944-9661-96f262316793 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:57.480829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ab3ea-ba58-4f2b-a27d-98a16aee7da4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:57.524930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fff09-3fc4-401a-a65c-db9c1eecb288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:57.525544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fff09-3fc4-401a-a65c-db9c1eecb288 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:57.526211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fff09-3fc4-401a-a65c-db9c1eecb288 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:57.526211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fff09-3fc4-401a-a65c-db9c1eecb288 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:57.526687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fff09-3fc4-401a-a65c-db9c1eecb288 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:57.532494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fff09-3fc4-401a-a65c-db9c1eecb288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:57.532494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fff09-3fc4-401a-a65c-db9c1eecb288 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:57.534334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 429/857] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:51:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:57.540308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fff09-3fc4-401a-a65c-db9c1eecb288 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:57.542722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eaa6e-4890-4944-9661-96f262316793 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:57.544003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:57.583337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fdd4b-5644-4a92-9de6-e090e1b60e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:57.583920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fdd4b-5644-4a92-9de6-e090e1b60e37 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:57.584298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fdd4b-5644-4a92-9de6-e090e1b60e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:57.584606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fdd4b-5644-4a92-9de6-e090e1b60e37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:57.596533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fdd4b-5644-4a92-9de6-e090e1b60e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4b4fdd4b-5644-4a92-9de6-e090e1b60e37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:51:57.601945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:57.602910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:51:57.603767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:57.607853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 429/858] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:51:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:57.609221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fdd4b-5644-4a92-9de6-e090e1b60e37 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:57.671908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:57.679980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fff09-3fc4-401a-a65c-db9c1eecb288 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:57.740176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fdd4b-5644-4a92-9de6-e090e1b60e37 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:57.742141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb65bf5-2aee-43e6-94fe-3412a8890d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:57.744008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65bf5-2aee-43e6-94fe-3412a8890d14 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:57.744536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65bf5-2aee-43e6-94fe-3412a8890d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:57.745014 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb65bf5-2aee-43e6-94fe-3412a8890d14 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:57.745868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb65bf5-2aee-43e6-94fe-3412a8890d14 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:57.746374 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb65bf5-2aee-43e6-94fe-3412a8890d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:57.747946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb65bf5-2aee-43e6-94fe-3412a8890d14 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:57.757470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 430/859] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:51:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:57.787064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9138e-0d66-48a5-8fa5-b3e7c58d442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:57.788001 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9138e-0d66-48a5-8fa5-b3e7c58d442f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:57.788436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9138e-0d66-48a5-8fa5-b3e7c58d442f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:57.788895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9138e-0d66-48a5-8fa5-b3e7c58d442f None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:57.789747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9138e-0d66-48a5-8fa5-b3e7c58d442f None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:57.790266 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9138e-0d66-48a5-8fa5-b3e7c58d442f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:57.791921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9138e-0d66-48a5-8fa5-b3e7c58d442f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:57.802255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 430/860] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:51:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:57.808590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb65bf5-2aee-43e6-94fe-3412a8890d14 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:57.888609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:57.929207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb65bf5-2aee-43e6-94fe-3412a8890d14 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:57.966248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c27df4-abcb-49f1-af1e-a6a219fd6227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:57.967214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c27df4-abcb-49f1-af1e-a6a219fd6227 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:57.967644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c27df4-abcb-49f1-af1e-a6a219fd6227 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:57.968064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c27df4-abcb-49f1-af1e-a6a219fd6227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:57.979777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c27df4-abcb-49f1-af1e-a6a219fd6227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:57.981520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c27df4-abcb-49f1-af1e-a6a219fd6227 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-05c27df4-abcb-49f1-af1e-a6a219fd6227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:57.997506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:57.998706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:57.999821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:57.999821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:57.999821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:58.001674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 431/861] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:58.007718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9138e-0d66-48a5-8fa5-b3e7c58d442f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:58.119544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9138e-0d66-48a5-8fa5-b3e7c58d442f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:58.131578 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:58.161367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d813-606d-4d46-a5f9-0c69523b687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:58.162016 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d813-606d-4d46-a5f9-0c69523b687a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:58.162395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d813-606d-4d46-a5f9-0c69523b687a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:58.162680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d813-606d-4d46-a5f9-0c69523b687a None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:58.163343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d813-606d-4d46-a5f9-0c69523b687a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:58.163655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d813-606d-4d46-a5f9-0c69523b687a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:58.165100 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d813-606d-4d46-a5f9-0c69523b687a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:58.179189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 431/862] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:58.185003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c27df4-abcb-49f1-af1e-a6a219fd6227 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:58.246539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df515-c8c9-441a-a72a-a6aa61c779ec None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:58.246859 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df515-c8c9-441a-a72a-a6aa61c779ec None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:58.247159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df515-c8c9-441a-a72a-a6aa61c779ec None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:58.250671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 432/863] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:58.255862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e2f2d-a398-4089-aaa4-2957572ef2fa None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:58.256170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e2f2d-a398-4089-aaa4-2957572ef2fa None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:58.256540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e2f2d-a398-4089-aaa4-2957572ef2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:58.277557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f38e2f2d-a398-4089-aaa4-2957572ef2fa None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:58.278874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f38e2f2d-a398-4089-aaa4-2957572ef2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:58.309533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c27df4-abcb-49f1-af1e-a6a219fd6227 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:58.333561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:58.360551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf5b3-bbc7-482b-815d-ad10f6d7014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:58.361476 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf5b3-bbc7-482b-815d-ad10f6d7014c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:58.361759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf5b3-bbc7-482b-815d-ad10f6d7014c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:58.362041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf5b3-bbc7-482b-815d-ad10f6d7014c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:58.372904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf5b3-bbc7-482b-815d-ad10f6d7014c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:58.374365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf5b3-bbc7-482b-815d-ad10f6d7014c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:58.376976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 433/864] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5abbf5b3-bbc7-482b-815d-ad10f6d7014c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:51:58.386780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:58.387830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:58.388831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 432/865] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Aug 18 16:51:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:58.394169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e2f2d-a398-4089-aaa4-2957572ef2fa None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:58.504156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:58.507675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e2f2d-a398-4089-aaa4-2957572ef2fa None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:58.545240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227ba69-ae0b-4b81-8fc1-b0ee294a7f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:58.546649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227ba69-ae0b-4b81-8fc1-b0ee294a7f6d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:58.547142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227ba69-ae0b-4b81-8fc1-b0ee294a7f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:58.547595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227ba69-ae0b-4b81-8fc1-b0ee294a7f6d None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:58.548553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227ba69-ae0b-4b81-8fc1-b0ee294a7f6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:58.549045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227ba69-ae0b-4b81-8fc1-b0ee294a7f6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:58.550699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227ba69-ae0b-4b81-8fc1-b0ee294a7f6d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:58.570856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 434/866] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Aug 18 16:51:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:58.577252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf5b3-bbc7-482b-815d-ad10f6d7014c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:58.660437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227ba69-ae0b-4b81-8fc1-b0ee294a7f6d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:58.690146 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf5b3-bbc7-482b-815d-ad10f6d7014c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:58.726557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813791a4-52ce-4ba1-9e30-fc09c79096ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:58.727185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813791a4-52ce-4ba1-9e30-fc09c79096ad None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:58.727465 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813791a4-52ce-4ba1-9e30-fc09c79096ad None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:58.727734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813791a4-52ce-4ba1-9e30-fc09c79096ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:58.781091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227ba69-ae0b-4b81-8fc1-b0ee294a7f6d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:58.782819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:58.807083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813791a4-52ce-4ba1-9e30-fc09c79096ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:58.809039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813791a4-52ce-4ba1-9e30-fc09c79096ad None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:58.821647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494e384-d490-4dfe-898b-555b8dad952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:58.822272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e384-d490-4dfe-898b-555b8dad952e None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:58.822557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e384-d490-4dfe-898b-555b8dad952e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:58.822956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e384-d490-4dfe-898b-555b8dad952e None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:58.823691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494e384-d490-4dfe-898b-555b8dad952e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:58.825127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494e384-d490-4dfe-898b-555b8dad952e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:58.843337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 435/867] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:51:58 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:51:58.941166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 433/868] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:51:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:51:58.946671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494e384-d490-4dfe-898b-555b8dad952e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:58.976902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:59.082305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494e384-d490-4dfe-898b-555b8dad952e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:59.105735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94de13-f56f-4a0a-80ee-90e795a2a18f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.106074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94de13-f56f-4a0a-80ee-90e795a2a18f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.106357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94de13-f56f-4a0a-80ee-90e795a2a18f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.107857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 434/869] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:59.114323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db45b8-a007-403e-8ab0-96e20d29f05b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.114323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db45b8-a007-403e-8ab0-96e20d29f05b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.114323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db45b8-a007-403e-8ab0-96e20d29f05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.126462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4a74-7971-4a18-9300-0af05163e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:59.127228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4a74-7971-4a18-9300-0af05163e0ca None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.127514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4a74-7971-4a18-9300-0af05163e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.127792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4a74-7971-4a18-9300-0af05163e0ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.134766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-41db45b8-a007-403e-8ab0-96e20d29f05b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:59.136214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-41db45b8-a007-403e-8ab0-96e20d29f05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:59.141444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed4a74-7971-4a18-9300-0af05163e0ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:59.143003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed4a74-7971-4a18-9300-0af05163e0ca None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a6ed4a74-7971-4a18-9300-0af05163e0ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:51:59.163023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:59.164070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:51:59.169714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:51:59.169714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:51:59.169714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:51:59.169714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 436/870] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:59.171534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4a74-7971-4a18-9300-0af05163e0ca None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:59.240508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 435/871] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:51:59.253258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:59.290427 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4a74-7971-4a18-9300-0af05163e0ca None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:59.326948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe215-5ef2-410d-bf05-4404ae12c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:59.327619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe215-5ef2-410d-bf05-4404ae12c00a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.327909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe215-5ef2-410d-bf05-4404ae12c00a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.328220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe215-5ef2-410d-bf05-4404ae12c00a None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.328964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe215-5ef2-410d-bf05-4404ae12c00a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:59.329271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe215-5ef2-410d-bf05-4404ae12c00a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:59.330709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe215-5ef2-410d-bf05-4404ae12c00a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:59.343069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 437/872] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:59.349637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db45b8-a007-403e-8ab0-96e20d29f05b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:59.361116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:59.464655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db45b8-a007-403e-8ab0-96e20d29f05b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:59.501176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172821de-2f5b-4e5a-a0c5-d3f2357c9dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:59.501821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172821de-2f5b-4e5a-a0c5-d3f2357c9dbd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.502104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172821de-2f5b-4e5a-a0c5-d3f2357c9dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.502381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172821de-2f5b-4e5a-a0c5-d3f2357c9dbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.509376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172821de-2f5b-4e5a-a0c5-d3f2357c9dbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:59.510855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172821de-2f5b-4e5a-a0c5-d3f2357c9dbd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-172821de-2f5b-4e5a-a0c5-d3f2357c9dbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:51:59.522908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:59.523868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:59.524828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:51:59.524828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:51:59.524828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:51:59.524828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:51:59.524828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:51:59.524828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:51:59.524828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:51:59.524828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:59.524828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 436/873] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:51:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:51:59.530839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe215-5ef2-410d-bf05-4404ae12c00a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:59.534057 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172821de-2f5b-4e5a-a0c5-d3f2357c9dbd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:59.605529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:59.644615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172821de-2f5b-4e5a-a0c5-d3f2357c9dbd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:59.659289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe215-5ef2-410d-bf05-4404ae12c00a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:59.681476 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0d14-5453-4b0a-9b70-4eb7ed294e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:59.682513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0d14-5453-4b0a-9b70-4eb7ed294e25 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.683031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0d14-5453-4b0a-9b70-4eb7ed294e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.683505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0d14-5453-4b0a-9b70-4eb7ed294e25 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.684306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b0d14-5453-4b0a-9b70-4eb7ed294e25 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:59.685892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b0d14-5453-4b0a-9b70-4eb7ed294e25 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:59.694275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d57b0d14-5453-4b0a-9b70-4eb7ed294e25 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:51:59.696625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:51:59.697618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:51:59.698489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:51:59.699249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32265d49-ac7e-40ac-bc15-94503b8747aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:59.699249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32265d49-ac7e-40ac-bc15-94503b8747aa None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.699249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32265d49-ac7e-40ac-bc15-94503b8747aa None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.699249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32265d49-ac7e-40ac-bc15-94503b8747aa None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.699522 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32265d49-ac7e-40ac-bc15-94503b8747aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:59.699522 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32265d49-ac7e-40ac-bc15-94503b8747aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:59.706143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32265d49-ac7e-40ac-bc15-94503b8747aa None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:59.706690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 437/874] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:51:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:51:59.707769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0d14-5453-4b0a-9b70-4eb7ed294e25 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:59.715875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 438/875] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:51:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:59.721798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32265d49-ac7e-40ac-bc15-94503b8747aa None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:59.818606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0d14-5453-4b0a-9b70-4eb7ed294e25 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:59.830489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32265d49-ac7e-40ac-bc15-94503b8747aa None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:51:59.851185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:51:59.858096 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092c7c0-ab7e-4a41-ae95-053cf6cbd1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:59.858752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092c7c0-ab7e-4a41-ae95-053cf6cbd1ca None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.859038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092c7c0-ab7e-4a41-ae95-053cf6cbd1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.859346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092c7c0-ab7e-4a41-ae95-053cf6cbd1ca None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.859984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092c7c0-ab7e-4a41-ae95-053cf6cbd1ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:59.860291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092c7c0-ab7e-4a41-ae95-053cf6cbd1ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:59.861696 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092c7c0-ab7e-4a41-ae95-053cf6cbd1ca None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:59.866735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 438/876] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Aug 18 16:51:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:51:59.867944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8b92-cf5c-470f-8497-e8537782fb11 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.868227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8b92-cf5c-470f-8497-e8537782fb11 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.868530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8b92-cf5c-470f-8497-e8537782fb11 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.873903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 439/877] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:51:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:51:59.873903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a8b92-cf5c-470f-8497-e8537782fb11 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:51:59.875974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79493c82-a0f5-4ccb-947f-ec30de5bbb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:51:59.876627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79493c82-a0f5-4ccb-947f-ec30de5bbb12 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.876907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79493c82-a0f5-4ccb-947f-ec30de5bbb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.877180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79493c82-a0f5-4ccb-947f-ec30de5bbb12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.877941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79493c82-a0f5-4ccb-947f-ec30de5bbb12 None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=2b359b4974ab4d91895106a37d32fb6c) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:51:59.878252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79493c82-a0f5-4ccb-947f-ec30de5bbb12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:51:59.879676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79493c82-a0f5-4ccb-947f-ec30de5bbb12 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:51:59.886149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 439/878] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:51:59 2022] GET /identity/v3/role_assignments?user.id=2b359b4974ab4d91895106a37d32fb6c&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:51:59.887532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae23a-397f-48a1-835c-45f414ed832d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:51:59.887821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae23a-397f-48a1-835c-45f414ed832d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:51:59.888099 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae23a-397f-48a1-835c-45f414ed832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:51:59.913328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c21ae23a-397f-48a1-835c-45f414ed832d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:51:59.914606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c21ae23a-397f-48a1-835c-45f414ed832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:51:59.985467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:00.002210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a8b92-cf5c-470f-8497-e8537782fb11 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:00.011509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 440/879] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:51:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:00.050030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1393-4143-4021-98b1-14e5e19dcaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:00.050672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1393-4143-4021-98b1-14e5e19dcaf7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:00.050957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1393-4143-4021-98b1-14e5e19dcaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:00.051236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1393-4143-4021-98b1-14e5e19dcaf7 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:00.051868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1393-4143-4021-98b1-14e5e19dcaf7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:00.052170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1393-4143-4021-98b1-14e5e19dcaf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:00.053590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1393-4143-4021-98b1-14e5e19dcaf7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:00.058781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 440/880] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Aug 18 16:51:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:00.279006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae23a-397f-48a1-835c-45f414ed832d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:00.381933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae23a-397f-48a1-835c-45f414ed832d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:00.417720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b3b49-23a6-48d0-ae58-656e05951d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:00.418336 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b3b49-23a6-48d0-ae58-656e05951d72 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:00.418615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b3b49-23a6-48d0-ae58-656e05951d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:00.418890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b3b49-23a6-48d0-ae58-656e05951d72 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:00.419553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b3b49-23a6-48d0-ae58-656e05951d72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:00.420971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b3b49-23a6-48d0-ae58-656e05951d72 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:00.444647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 441/881] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:52:00 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:00.889844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c540f6a-4863-4d98-918e-198b0e79f5a2 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:00.890931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c540f6a-4863-4d98-918e-198b0e79f5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:00.891424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c540f6a-4863-4d98-918e-198b0e79f5a2 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:00.893262 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 441/882] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:00.898719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d785-18c5-4662-9f49-bb63b83a475d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:00.899560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d785-18c5-4662-9f49-bb63b83a475d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:00.900070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d785-18c5-4662-9f49-bb63b83a475d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:00.919602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b9f1d785-18c5-4662-9f49-bb63b83a475d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:00.921228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b9f1d785-18c5-4662-9f49-bb63b83a475d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:00.958933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:01.003177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 442/883] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:01.277115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c540f6a-4863-4d98-918e-198b0e79f5a2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:01.342316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:01.385777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c540f6a-4863-4d98-918e-198b0e79f5a2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:01.423853 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352de5a-3b63-49d3-9c65-4f3c45024b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:01.424532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352de5a-3b63-49d3-9c65-4f3c45024b05 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:01.424821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352de5a-3b63-49d3-9c65-4f3c45024b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:01.425099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352de5a-3b63-49d3-9c65-4f3c45024b05 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:01.425694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352de5a-3b63-49d3-9c65-4f3c45024b05 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:01.427067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352de5a-3b63-49d3-9c65-4f3c45024b05 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5352de5a-3b63-49d3-9c65-4f3c45024b05 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:01.438151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:01.439309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:01.440328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 442/884] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:52:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:01.448225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d785-18c5-4662-9f49-bb63b83a475d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:01.553745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d785-18c5-4662-9f49-bb63b83a475d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:01.594701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc086-d97f-448b-abd5-b5d8efae8b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:01.595753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc086-d97f-448b-abd5-b5d8efae8b9f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:01.596277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc086-d97f-448b-abd5-b5d8efae8b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:01.596801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bc086-d97f-448b-abd5-b5d8efae8b9f None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:01.597688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc086-d97f-448b-abd5-b5d8efae8b9f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:01.598241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc086-d97f-448b-abd5-b5d8efae8b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:01.599895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bc086-d97f-448b-abd5-b5d8efae8b9f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:01.605976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 443/885] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:52:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:01.611980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352de5a-3b63-49d3-9c65-4f3c45024b05 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:01.732677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352de5a-3b63-49d3-9c65-4f3c45024b05 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:01.759708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:01.771114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a108-bfd3-4b37-a5b8-9e3022d8219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:01.771732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a108-bfd3-4b37-a5b8-9e3022d8219e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:01.772020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a108-bfd3-4b37-a5b8-9e3022d8219e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:01.772298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a108-bfd3-4b37-a5b8-9e3022d8219e None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:01.772972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a108-bfd3-4b37-a5b8-9e3022d8219e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:01.773282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a108-bfd3-4b37-a5b8-9e3022d8219e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:01.774649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a108-bfd3-4b37-a5b8-9e3022d8219e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:01.780133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 443/886] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:52:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:01.785995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc086-d97f-448b-abd5-b5d8efae8b9f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:01.819210 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:01.893253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bc086-d97f-448b-abd5-b5d8efae8b9f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:01.928883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aacf9-f12b-4d3c-a749-cfb6c5893690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:01.929650 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aacf9-f12b-4d3c-a749-cfb6c5893690 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:01.929915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aacf9-f12b-4d3c-a749-cfb6c5893690 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:01.930194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aacf9-f12b-4d3c-a749-cfb6c5893690 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:01.930906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aacf9-f12b-4d3c-a749-cfb6c5893690 None admin] RBAC: Adding query filter params (interface=public, service_id=5e34aeb85dba4e16ba8be208322be91d, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:01.931219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aacf9-f12b-4d3c-a749-cfb6c5893690 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:01.932627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aacf9-f12b-4d3c-a749-cfb6c5893690 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:01.938738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 444/887] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Aug 18 16:52:01 2022] GET /identity/v3/endpoints?service_id=5e34aeb85dba4e16ba8be208322be91d&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:01.944291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a108-bfd3-4b37-a5b8-9e3022d8219e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:01.950580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d2db-1d26-4d2d-b5bf-25d41041495b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:01.950874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d2db-1d26-4d2d-b5bf-25d41041495b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:01.951163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19d2db-1d26-4d2d-b5bf-25d41041495b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:01.952786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 445/888] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:01.959531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6827-e010-41ba-a2c1-5c80c39bb909 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:01.959531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6827-e010-41ba-a2c1-5c80c39bb909 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:01.959531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6827-e010-41ba-a2c1-5c80c39bb909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:01.978131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-002b6827-e010-41ba-a2c1-5c80c39bb909 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:01.979454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-002b6827-e010-41ba-a2c1-5c80c39bb909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:02.060990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 446/889] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:02.066578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a108-bfd3-4b37-a5b8-9e3022d8219e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:02.072944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874ae60-47a3-4704-8872-37a96f43c108 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:02.073520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874ae60-47a3-4704-8872-37a96f43c108 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:02.074050 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874ae60-47a3-4704-8872-37a96f43c108 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:02.075984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 447/890] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:52:02.081351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164da7a2-0aa0-4aed-86f7-d0c9d4141ef4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:02.081722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164da7a2-0aa0-4aed-86f7-d0c9d4141ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:02.082200 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164da7a2-0aa0-4aed-86f7-d0c9d4141ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:02.102036 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-164da7a2-0aa0-4aed-86f7-d0c9d4141ef4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:02.103534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-164da7a2-0aa0-4aed-86f7-d0c9d4141ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:02.104605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f40e-19d1-47f1-a4c3-4c97c6c7dbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:02.105346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f40e-19d1-47f1-a4c3-4c97c6c7dbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:02.105694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f40e-19d1-47f1-a4c3-4c97c6c7dbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:02.106042 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f40e-19d1-47f1-a4c3-4c97c6c7dbd0 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:02.106935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f40e-19d1-47f1-a4c3-4c97c6c7dbd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:02.109916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f40e-19d1-47f1-a4c3-4c97c6c7dbd0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:02.120499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 444/891] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Aug 18 16:52:01 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:52:02.134226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:02.187454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 448/892] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:02.342574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f40e-19d1-47f1-a4c3-4c97c6c7dbd0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:02.402112 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:02.454448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f40e-19d1-47f1-a4c3-4c97c6c7dbd0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:02.473130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ff37-04dd-4652-9841-0279bf642b0f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:02.473757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ff37-04dd-4652-9841-0279bf642b0f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:02.474232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ff37-04dd-4652-9841-0279bf642b0f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:02.477215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 449/893] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:02.481750 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4361e-d970-4579-b742-1cb6aed874b5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:02.482306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4361e-d970-4579-b742-1cb6aed874b5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:02.482799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4361e-d970-4579-b742-1cb6aed874b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:02.492407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ef112-5a4e-495e-97ba-92dd25d06f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:02.493138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ef112-5a4e-495e-97ba-92dd25d06f7a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:02.493427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ef112-5a4e-495e-97ba-92dd25d06f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:02.493705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ef112-5a4e-495e-97ba-92dd25d06f7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:02.502488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b2a4361e-d970-4579-b742-1cb6aed874b5 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:02.503671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b2a4361e-d970-4579-b742-1cb6aed874b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:02.504745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ef112-5a4e-495e-97ba-92dd25d06f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b28ef112-5a4e-495e-97ba-92dd25d06f7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:02.510035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:02.510966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:02.511861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 445/894] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Aug 18 16:52:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:02.512653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ef112-5a4e-495e-97ba-92dd25d06f7a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:02.580548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 450/895] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:02.580548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4361e-d970-4579-b742-1cb6aed874b5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:02.635919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ef112-5a4e-495e-97ba-92dd25d06f7a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:02.654035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:02.673054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:02.682910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43074b13-1dc3-4045-bc58-d3231001c51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:02.683487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43074b13-1dc3-4045-bc58-d3231001c51e None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:02.683772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43074b13-1dc3-4045-bc58-d3231001c51e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:02.684049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43074b13-1dc3-4045-bc58-d3231001c51e None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:02.684738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43074b13-1dc3-4045-bc58-d3231001c51e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:02.686329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43074b13-1dc3-4045-bc58-d3231001c51e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:02.692330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4361e-d970-4579-b742-1cb6aed874b5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:02.704022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 446/896] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:52:02 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:02.754538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1b30c-0220-44cf-a6ec-d59ed974d73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:02.755569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1b30c-0220-44cf-a6ec-d59ed974d73e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:02.756095 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1b30c-0220-44cf-a6ec-d59ed974d73e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:02.756645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1b30c-0220-44cf-a6ec-d59ed974d73e None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:02.757534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1b30c-0220-44cf-a6ec-d59ed974d73e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:02.758106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1b30c-0220-44cf-a6ec-d59ed974d73e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:02.759739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1b30c-0220-44cf-a6ec-d59ed974d73e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:02.770680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 451/897] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Aug 18 16:52:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:02.776244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43074b13-1dc3-4045-bc58-d3231001c51e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:02.866598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1b30c-0220-44cf-a6ec-d59ed974d73e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:02.901253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43074b13-1dc3-4045-bc58-d3231001c51e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:02.940869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de6f0-b9df-4868-ba1e-a8abc829fbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:02.941751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de6f0-b9df-4868-ba1e-a8abc829fbec None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:02.942200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de6f0-b9df-4868-ba1e-a8abc829fbec None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:02.942618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de6f0-b9df-4868-ba1e-a8abc829fbec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:02.953940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70de6f0-b9df-4868-ba1e-a8abc829fbec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:02.956028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70de6f0-b9df-4868-ba1e-a8abc829fbec None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c70de6f0-b9df-4868-ba1e-a8abc829fbec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:02.971383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:02.972572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:02.973674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:02.973674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:02.973674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:02.975100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 447/898] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:02.980853 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de6f0-b9df-4868-ba1e-a8abc829fbec None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:02.994074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1b30c-0220-44cf-a6ec-d59ed974d73e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:03.008999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:03.042310 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738c3dc-85e9-4c69-a63b-84889f601de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:03.043247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738c3dc-85e9-4c69-a63b-84889f601de5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:03.043529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738c3dc-85e9-4c69-a63b-84889f601de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:03.043847 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738c3dc-85e9-4c69-a63b-84889f601de5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:03.044881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738c3dc-85e9-4c69-a63b-84889f601de5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:03.046768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738c3dc-85e9-4c69-a63b-84889f601de5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5738c3dc-85e9-4c69-a63b-84889f601de5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:03.058530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:03.059564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:03.060452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 452/899] 10.222.0.81 () {56 vars in 1132 bytes} [Thu Aug 18 16:52:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:03.068221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738c3dc-85e9-4c69-a63b-84889f601de5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:03.080845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:03.103937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de6f0-b9df-4868-ba1e-a8abc829fbec None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:03.149775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcd038-bf81-4a18-ae0a-92eb6c8c776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:03.151075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcd038-bf81-4a18-ae0a-92eb6c8c776a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:03.151819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcd038-bf81-4a18-ae0a-92eb6c8c776a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:03.152243 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcd038-bf81-4a18-ae0a-92eb6c8c776a None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:03.153351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcd038-bf81-4a18-ae0a-92eb6c8c776a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:03.154218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcd038-bf81-4a18-ae0a-92eb6c8c776a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:03.156043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcd038-bf81-4a18-ae0a-92eb6c8c776a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:03.177760 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 448/900] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:03.179151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcd038-bf81-4a18-ae0a-92eb6c8c776a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:03.207971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738c3dc-85e9-4c69-a63b-84889f601de5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:03.258218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9570b-b487-4208-b4e3-8d804f89c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:03.259246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9570b-b487-4208-b4e3-8d804f89c690 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:03.259764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9570b-b487-4208-b4e3-8d804f89c690 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:03.260543 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9570b-b487-4208-b4e3-8d804f89c690 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:03.262054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9570b-b487-4208-b4e3-8d804f89c690 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:03.262580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9570b-b487-4208-b4e3-8d804f89c690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:03.264770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9570b-b487-4208-b4e3-8d804f89c690 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:03.276383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 453/901] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:52:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:03.277379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9570b-b487-4208-b4e3-8d804f89c690 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:03.285926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:03.307918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcd038-bf81-4a18-ae0a-92eb6c8c776a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:03.346839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c8cce-52ed-4d1e-9866-7e5b86ea2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:03.347542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8cce-52ed-4d1e-9866-7e5b86ea2a08 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:03.347862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8cce-52ed-4d1e-9866-7e5b86ea2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:03.348093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c8cce-52ed-4d1e-9866-7e5b86ea2a08 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:03.356032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c8cce-52ed-4d1e-9866-7e5b86ea2a08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:03.357952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c8cce-52ed-4d1e-9866-7e5b86ea2a08 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-553c8cce-52ed-4d1e-9866-7e5b86ea2a08 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:52:03.370742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:03.371726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:03.372726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:03.372726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:03.372726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:52:03.372726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:52:03.372726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:52:03.372726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:52:03.372726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:52:03.372726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:52:03.372726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:52:03.372726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:03.377196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 449/902] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Aug 18 16:52:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:03.377846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:03.378965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c8cce-52ed-4d1e-9866-7e5b86ea2a08 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:03.423754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9570b-b487-4208-b4e3-8d804f89c690 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:03.471564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5bd6a-f014-4227-8b31-38f4ef234e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:03.472593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5bd6a-f014-4227-8b31-38f4ef234e18 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:03.472974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5bd6a-f014-4227-8b31-38f4ef234e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:03.473793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5bd6a-f014-4227-8b31-38f4ef234e18 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:03.474594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5bd6a-f014-4227-8b31-38f4ef234e18 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:03.474971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5bd6a-f014-4227-8b31-38f4ef234e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:03.476992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5bd6a-f014-4227-8b31-38f4ef234e18 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:03.488895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 454/903] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:52:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:03.490562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5bd6a-f014-4227-8b31-38f4ef234e18 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:03.495686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c8cce-52ed-4d1e-9866-7e5b86ea2a08 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:03.532772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefd0af-2fc3-4044-b0a3-cc14a6d1e8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:03.533396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefd0af-2fc3-4044-b0a3-cc14a6d1e8cc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:03.533680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefd0af-2fc3-4044-b0a3-cc14a6d1e8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:03.534042 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefd0af-2fc3-4044-b0a3-cc14a6d1e8cc None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:03.534763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefd0af-2fc3-4044-b0a3-cc14a6d1e8cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:03.535067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefd0af-2fc3-4044-b0a3-cc14a6d1e8cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:03.536504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefd0af-2fc3-4044-b0a3-cc14a6d1e8cc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:03.560596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 450/904] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Aug 18 16:52:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:03.562132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefd0af-2fc3-4044-b0a3-cc14a6d1e8cc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:03.565564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:03.627331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5bd6a-f014-4227-8b31-38f4ef234e18 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:03.671409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefd0af-2fc3-4044-b0a3-cc14a6d1e8cc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:03.674892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cc06c-e4e0-4ad0-91a7-c68986c17b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:03.675728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cc06c-e4e0-4ad0-91a7-c68986c17b61 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:03.676187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cc06c-e4e0-4ad0-91a7-c68986c17b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:03.676685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cc06c-e4e0-4ad0-91a7-c68986c17b61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:03.677567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cc06c-e4e0-4ad0-91a7-c68986c17b61 None admin] RBAC: Adding query filter params (interface=public, service_id=e08bc28970e442be9f907a98d0fb6912, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:03.678054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cc06c-e4e0-4ad0-91a7-c68986c17b61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:03.679598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cc06c-e4e0-4ad0-91a7-c68986c17b61 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:03.681960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:03.688389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 455/905] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Aug 18 16:52:03 2022] GET /identity/v3/endpoints?service_id=e08bc28970e442be9f907a98d0fb6912&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:03.694273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cc06c-e4e0-4ad0-91a7-c68986c17b61 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:03.719446 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa7860-4a05-4e70-ac12-a28a5f0e5242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:03.720365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa7860-4a05-4e70-ac12-a28a5f0e5242 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:03.720940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa7860-4a05-4e70-ac12-a28a5f0e5242 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:03.721493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa7860-4a05-4e70-ac12-a28a5f0e5242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:03.798578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa7860-4a05-4e70-ac12-a28a5f0e5242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:03.800046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa7860-4a05-4e70-ac12-a28a5f0e5242 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:03.802181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:03.834886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cc06c-e4e0-4ad0-91a7-c68986c17b61 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:03.870971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bfb4d-81d4-4f73-9a63-71b714cad5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:03.871589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bfb4d-81d4-4f73-9a63-71b714cad5cd None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:03.871870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bfb4d-81d4-4f73-9a63-71b714cad5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:03.872146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bfb4d-81d4-4f73-9a63-71b714cad5cd None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:03.872824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bfb4d-81d4-4f73-9a63-71b714cad5cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:03.874214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bfb4d-81d4-4f73-9a63-71b714cad5cd None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:03.881551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 456/906] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Aug 18 16:52:03 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:52:03.934955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 451/907] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:03 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:52:03.940784 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bfb4d-81d4-4f73-9a63-71b714cad5cd None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:04.015917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:04.072398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bfb4d-81d4-4f73-9a63-71b714cad5cd None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:04.112112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffea777-3ebf-49f6-b77e-d56800cc43ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:04.113131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffea777-3ebf-49f6-b77e-d56800cc43ea None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.113615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffea777-3ebf-49f6-b77e-d56800cc43ea None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.114342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffea777-3ebf-49f6-b77e-d56800cc43ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.114776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff0df2-bef9-40c9-a107-c513ffdd2739 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.115220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff0df2-bef9-40c9-a107-c513ffdd2739 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.115378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff0df2-bef9-40c9-a107-c513ffdd2739 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.116966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 452/908] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:52:04.121915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50890-23f2-498f-8756-2004a0d94004 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.122201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50890-23f2-498f-8756-2004a0d94004 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.122485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50890-23f2-498f-8756-2004a0d94004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.128261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffea777-3ebf-49f6-b77e-d56800cc43ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:04.130039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffea777-3ebf-49f6-b77e-d56800cc43ea None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:04.141392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a3d50890-23f2-498f-8756-2004a0d94004 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:04.142979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a3d50890-23f2-498f-8756-2004a0d94004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-fffea777-3ebf-49f6-b77e-d56800cc43ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:04.145421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:04.146363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:04.147296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:04.147296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:04.147296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:04.147296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 457/909] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:04.153320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffea777-3ebf-49f6-b77e-d56800cc43ea None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:04.236565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 453/910] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:04.280565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffea777-3ebf-49f6-b77e-d56800cc43ea None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:04.295856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:04.318146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c4ff6-e0d3-4abc-a25d-9a467a5574a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:04.318762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c4ff6-e0d3-4abc-a25d-9a467a5574a2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.319045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c4ff6-e0d3-4abc-a25d-9a467a5574a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.319320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c4ff6-e0d3-4abc-a25d-9a467a5574a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.319960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c4ff6-e0d3-4abc-a25d-9a467a5574a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:04.320399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c4ff6-e0d3-4abc-a25d-9a467a5574a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:04.321919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c4ff6-e0d3-4abc-a25d-9a467a5574a2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:04.340696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 458/911] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:04.343117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d50890-23f2-498f-8756-2004a0d94004 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:04.377887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:04.453661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d50890-23f2-498f-8756-2004a0d94004 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:04.490349 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64345cd3-9f55-450e-93bb-8f3e4344fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:04.490909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64345cd3-9f55-450e-93bb-8f3e4344fb27 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.491188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64345cd3-9f55-450e-93bb-8f3e4344fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.491461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64345cd3-9f55-450e-93bb-8f3e4344fb27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.498630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64345cd3-9f55-450e-93bb-8f3e4344fb27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:04.500636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64345cd3-9f55-450e-93bb-8f3e4344fb27 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:04.509288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c4ff6-e0d3-4abc-a25d-9a467a5574a2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-64345cd3-9f55-450e-93bb-8f3e4344fb27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:52:04.516619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:04.517579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:04.518572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:52:04.518572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:52:04.518572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:52:04.518572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:52:04.518572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:52:04.518572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:52:04.518572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:04.518572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:04.522268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 454/912] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:04.525416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64345cd3-9f55-450e-93bb-8f3e4344fb27 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:04.628673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c4ff6-e0d3-4abc-a25d-9a467a5574a2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:04.656525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:04.669275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64345cd3-9f55-450e-93bb-8f3e4344fb27 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:04.670478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0afac-1d43-42f4-8cab-3031d2470f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:04.671389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0afac-1d43-42f4-8cab-3031d2470f0a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.672396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0afac-1d43-42f4-8cab-3031d2470f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.672892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0afac-1d43-42f4-8cab-3031d2470f0a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.673681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0afac-1d43-42f4-8cab-3031d2470f0a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:04.675340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0afac-1d43-42f4-8cab-3031d2470f0a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-aff0afac-1d43-42f4-8cab-3031d2470f0a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:04.685228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:04.686255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 16:52:04.687114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:04.695328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 459/913] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:52:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:04.696576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0afac-1d43-42f4-8cab-3031d2470f0a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:04.712529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8cbbe-fffe-4b50-8b98-0b87ad6a88cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:04.713276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8cbbe-fffe-4b50-8b98-0b87ad6a88cb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.713583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8cbbe-fffe-4b50-8b98-0b87ad6a88cb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.713864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8cbbe-fffe-4b50-8b98-0b87ad6a88cb None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.714560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8cbbe-fffe-4b50-8b98-0b87ad6a88cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:04.714867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8cbbe-fffe-4b50-8b98-0b87ad6a88cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:04.716777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8cbbe-fffe-4b50-8b98-0b87ad6a88cb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:04.738128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 455/914] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:04.739949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8cbbe-fffe-4b50-8b98-0b87ad6a88cb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:04.759770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:04.822782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0afac-1d43-42f4-8cab-3031d2470f0a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:04.858619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77ae09-c346-425c-97e6-37b19d77880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:04.859758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77ae09-c346-425c-97e6-37b19d77880c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.860040 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77ae09-c346-425c-97e6-37b19d77880c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.860313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77ae09-c346-425c-97e6-37b19d77880c None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.860971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77ae09-c346-425c-97e6-37b19d77880c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:04.861274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77ae09-c346-425c-97e6-37b19d77880c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:04.861377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8cbbe-fffe-4b50-8b98-0b87ad6a88cb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:04.862643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77ae09-c346-425c-97e6-37b19d77880c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:04.874479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 460/915] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:52:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:04.874479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b1cc0-6044-4f1e-a7af-c7021aa23d26 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.874479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b1cc0-6044-4f1e-a7af-c7021aa23d26 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.874479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b1cc0-6044-4f1e-a7af-c7021aa23d26 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.874479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 461/916] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:04.882137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48497fe5-abc3-4bf3-b88f-ad487bfcff2a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.882418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48497fe5-abc3-4bf3-b88f-ad487bfcff2a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.882716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48497fe5-abc3-4bf3-b88f-ad487bfcff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.900501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-48497fe5-abc3-4bf3-b88f-ad487bfcff2a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:04.901680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-48497fe5-abc3-4bf3-b88f-ad487bfcff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:04.906730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19368609-e6e1-4b68-a41e-6384da2af905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:04.907424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19368609-e6e1-4b68-a41e-6384da2af905 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:04.907787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19368609-e6e1-4b68-a41e-6384da2af905 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:04.908130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19368609-e6e1-4b68-a41e-6384da2af905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:04.908971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19368609-e6e1-4b68-a41e-6384da2af905 None admin] RBAC: Adding query filter params (role.id=b8bacb93751c4fcdb352c4557a49cbc7, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=2b359b4974ab4d91895106a37d32fb6c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:04.909347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19368609-e6e1-4b68-a41e-6384da2af905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:04.910824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19368609-e6e1-4b68-a41e-6384da2af905 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:04.916699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 456/917] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:52:04 2022] GET /identity/v3/role_assignments?user.id=2b359b4974ab4d91895106a37d32fb6c&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b8bacb93751c4fcdb352c4557a49cbc7 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:04.925615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19368609-e6e1-4b68-a41e-6384da2af905 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:04.947903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:05.009198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 462/918] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:05.064543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19368609-e6e1-4b68-a41e-6384da2af905 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:05.103189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f067-d75b-42d1-bfb7-1dd0347e0acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:05.103817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f067-d75b-42d1-bfb7-1dd0347e0acf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:05.104103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f067-d75b-42d1-bfb7-1dd0347e0acf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:05.104383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f067-d75b-42d1-bfb7-1dd0347e0acf None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:05.105089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f067-d75b-42d1-bfb7-1dd0347e0acf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:05.105399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f067-d75b-42d1-bfb7-1dd0347e0acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:05.106837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f067-d75b-42d1-bfb7-1dd0347e0acf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:05.112841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 457/919] 10.222.0.81 () {56 vars in 1114 bytes} [Thu Aug 18 16:52:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:05.118722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48497fe5-abc3-4bf3-b88f-ad487bfcff2a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:05.153130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:05.232731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48497fe5-abc3-4bf3-b88f-ad487bfcff2a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:05.270243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a502ea-7a14-4ac8-b8c3-077678000bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:05.270899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a502ea-7a14-4ac8-b8c3-077678000bef None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:05.271189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a502ea-7a14-4ac8-b8c3-077678000bef None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:05.271471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a502ea-7a14-4ac8-b8c3-077678000bef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:05.272278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a502ea-7a14-4ac8-b8c3-077678000bef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:05.273701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a502ea-7a14-4ac8-b8c3-077678000bef None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:05.298375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 463/920] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 16:52:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:05.313304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f067-d75b-42d1-bfb7-1dd0347e0acf None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:05.415385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:05.438209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f067-d75b-42d1-bfb7-1dd0347e0acf None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:05.485180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31042213-55d1-49b5-a1e5-3e5a4f26c999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:05.486253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31042213-55d1-49b5-a1e5-3e5a4f26c999 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:05.486981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31042213-55d1-49b5-a1e5-3e5a4f26c999 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:05.487702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31042213-55d1-49b5-a1e5-3e5a4f26c999 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:05.488535 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31042213-55d1-49b5-a1e5-3e5a4f26c999 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:05.490364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31042213-55d1-49b5-a1e5-3e5a4f26c999 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-31042213-55d1-49b5-a1e5-3e5a4f26c999 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:05.499974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:05.501248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:05.502377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:05.504914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 458/921] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:52:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:05.510795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a502ea-7a14-4ac8-b8c3-077678000bef None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:05.608291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:05.623593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a502ea-7a14-4ac8-b8c3-077678000bef None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:05.661016 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476befa-d77d-46cf-a7b6-b6c3cea7a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:05.661644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476befa-d77d-46cf-a7b6-b6c3cea7a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:05.661975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476befa-d77d-46cf-a7b6-b6c3cea7a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:05.662262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476befa-d77d-46cf-a7b6-b6c3cea7a7f3 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:05.662910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476befa-d77d-46cf-a7b6-b6c3cea7a7f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:05.663221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476befa-d77d-46cf-a7b6-b6c3cea7a7f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:05.664737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476befa-d77d-46cf-a7b6-b6c3cea7a7f3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:05.670457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 464/922] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Aug 18 16:52:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:05.676233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31042213-55d1-49b5-a1e5-3e5a4f26c999 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:05.795118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31042213-55d1-49b5-a1e5-3e5a4f26c999 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:05.838114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a7af-e791-4ae3-9570-eef207a1473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:05.838781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a7af-e791-4ae3-9570-eef207a1473c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:05.839132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a7af-e791-4ae3-9570-eef207a1473c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:05.839417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a7af-e791-4ae3-9570-eef207a1473c None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:05.840060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a7af-e791-4ae3-9570-eef207a1473c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:05.840370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a7af-e791-4ae3-9570-eef207a1473c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:05.841824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a7af-e791-4ae3-9570-eef207a1473c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:05.848484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 459/923] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Aug 18 16:52:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:05.854452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476befa-d77d-46cf-a7b6-b6c3cea7a7f3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:05.903522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38eb9-4894-45f7-93b8-ca1cda5c05fe None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:05.903709 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38eb9-4894-45f7-93b8-ca1cda5c05fe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:05.903969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c38eb9-4894-45f7-93b8-ca1cda5c05fe None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:05.905654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 460/924] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:05.912122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58025-9cd7-4364-8545-c1602f6bee87 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:05.912431 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58025-9cd7-4364-8545-c1602f6bee87 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:05.912721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58025-9cd7-4364-8545-c1602f6bee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:05.920104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:05.939096 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1cd58025-9cd7-4364-8545-c1602f6bee87 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:05.940663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1cd58025-9cd7-4364-8545-c1602f6bee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:05.972084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476befa-d77d-46cf-a7b6-b6c3cea7a7f3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:06.015544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c420-73f3-4eef-b8d0-08644308ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:06.024483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c420-73f3-4eef-b8d0-08644308ff87 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:06.024483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c420-73f3-4eef-b8d0-08644308ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:06.024483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9c420-73f3-4eef-b8d0-08644308ff87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:06.024483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9c420-73f3-4eef-b8d0-08644308ff87 None admin] RBAC: Adding query filter params (interface=public, service_id=ee1a2405c46d40d3bfc59a93241f5b37, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:06.024483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9c420-73f3-4eef-b8d0-08644308ff87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:06.024483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9c420-73f3-4eef-b8d0-08644308ff87 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:06.025329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 461/926] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:06.029668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 465/926] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Aug 18 16:52:05 2022] GET /identity/v3/endpoints?service_id=ee1a2405c46d40d3bfc59a93241f5b37&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:06.031534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd58025-9cd7-4364-8545-c1602f6bee87 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:06.143849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd58025-9cd7-4364-8545-c1602f6bee87 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:06.182531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156d852-03d7-4732-9ada-a0588ad9908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:06.183254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156d852-03d7-4732-9ada-a0588ad9908b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:06.183533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156d852-03d7-4732-9ada-a0588ad9908b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:06.183807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156d852-03d7-4732-9ada-a0588ad9908b None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:06.184586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156d852-03d7-4732-9ada-a0588ad9908b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:06.186217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156d852-03d7-4732-9ada-a0588ad9908b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:06.187245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:06.200618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 462/927] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Aug 18 16:52:06 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:52:06.292420 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c420-73f3-4eef-b8d0-08644308ff87 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:06.315533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:06.418584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9c420-73f3-4eef-b8d0-08644308ff87 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:06.456773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4ef22-570f-472c-b790-cb78647ef220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:06.457339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4ef22-570f-472c-b790-cb78647ef220 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:06.457679 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4ef22-570f-472c-b790-cb78647ef220 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:06.458004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4ef22-570f-472c-b790-cb78647ef220 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:06.458610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4ef22-570f-472c-b790-cb78647ef220 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:06.460049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4ef22-570f-472c-b790-cb78647ef220 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b5a4ef22-570f-472c-b790-cb78647ef220 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:06.470120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:06.471137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:06.472067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 466/928] 10.222.0.81 () {56 vars in 1132 bytes} [Thu Aug 18 16:52:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:06.477640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156d852-03d7-4732-9ada-a0588ad9908b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:06.602934 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156d852-03d7-4732-9ada-a0588ad9908b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:06.644627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cc0e8-4ab2-415e-b1f1-890dbd140538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:06.645372 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cc0e8-4ab2-415e-b1f1-890dbd140538 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:06.645751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cc0e8-4ab2-415e-b1f1-890dbd140538 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:06.646086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cc0e8-4ab2-415e-b1f1-890dbd140538 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:06.646775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cc0e8-4ab2-415e-b1f1-890dbd140538 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:06.647081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cc0e8-4ab2-415e-b1f1-890dbd140538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:06.648678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cc0e8-4ab2-415e-b1f1-890dbd140538 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:06.655111 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 463/929] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:52:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:06.660503 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4ef22-570f-472c-b790-cb78647ef220 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:06.754135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:06.780391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4ef22-570f-472c-b790-cb78647ef220 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:06.819060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630588cf-e128-447c-a6ab-368300a2fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:06.819687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630588cf-e128-447c-a6ab-368300a2fc85 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:06.819967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630588cf-e128-447c-a6ab-368300a2fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:06.820246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630588cf-e128-447c-a6ab-368300a2fc85 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:06.820994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630588cf-e128-447c-a6ab-368300a2fc85 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:06.821307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630588cf-e128-447c-a6ab-368300a2fc85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:06.822756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630588cf-e128-447c-a6ab-368300a2fc85 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:06.829360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 467/930] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:52:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:06.834818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cc0e8-4ab2-415e-b1f1-890dbd140538 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:06.904372 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:06.952131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cc0e8-4ab2-415e-b1f1-890dbd140538 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:06.994114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60493e-ff77-4676-b70e-9272280d099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:06.995219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60493e-ff77-4676-b70e-9272280d099a None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:06.995757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60493e-ff77-4676-b70e-9272280d099a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:06.996383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60493e-ff77-4676-b70e-9272280d099a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:06.997379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60493e-ff77-4676-b70e-9272280d099a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:06.999172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60493e-ff77-4676-b70e-9272280d099a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:07.024593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 464/931] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 16:52:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:07.047712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308912-65eb-4075-92ba-f1ae5accb0ca None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:07.048082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308912-65eb-4075-92ba-f1ae5accb0ca None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:07.048421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79308912-65eb-4075-92ba-f1ae5accb0ca None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:07.050247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 468/932] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:07.057562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad81a08-8a3b-4206-b2d8-d70d5b292922 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:07.058304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad81a08-8a3b-4206-b2d8-d70d5b292922 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:07.058888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad81a08-8a3b-4206-b2d8-d70d5b292922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:07.082746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-aad81a08-8a3b-4206-b2d8-d70d5b292922 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:07.084686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-aad81a08-8a3b-4206-b2d8-d70d5b292922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:07.184613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 465/933] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:07.427060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4c06c-3d51-4bb7-b2c7-f417e91bf28f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:07.427586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4c06c-3d51-4bb7-b2c7-f417e91bf28f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:07.427688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4c06c-3d51-4bb7-b2c7-f417e91bf28f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:07.429287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 469/934] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:07.434504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf2bf2-1948-4cd1-b8b1-c7a4fc1530a1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:07.434795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf2bf2-1948-4cd1-b8b1-c7a4fc1530a1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:07.435075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf2bf2-1948-4cd1-b8b1-c7a4fc1530a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:07.454495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-efdf2bf2-1948-4cd1-b8b1-c7a4fc1530a1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:07.455684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-efdf2bf2-1948-4cd1-b8b1-c7a4fc1530a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:07.471053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4c06c-3d51-4bb7-b2c7-f417e91bf28f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:07.503327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:07.553553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 466/935] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:07.614013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4c06c-3d51-4bb7-b2c7-f417e91bf28f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:07.651361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777e82d-8a14-4ea7-b71e-a16a44d4b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:07.652390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777e82d-8a14-4ea7-b71e-a16a44d4b038 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:07.652972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777e82d-8a14-4ea7-b71e-a16a44d4b038 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:07.653479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777e82d-8a14-4ea7-b71e-a16a44d4b038 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:07.664726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777e82d-8a14-4ea7-b71e-a16a44d4b038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5777e82d-8a14-4ea7-b71e-a16a44d4b038 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:07.669780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:07.670785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:07.672202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:07.679515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 470/936] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Aug 18 16:52:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:07.681112 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf2bf2-1948-4cd1-b8b1-c7a4fc1530a1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:07.785827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf2bf2-1948-4cd1-b8b1-c7a4fc1530a1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:07.825119 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1336e5b-488a-4cba-872a-75477c6cb592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:07.825734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1336e5b-488a-4cba-872a-75477c6cb592 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:07.826015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1336e5b-488a-4cba-872a-75477c6cb592 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:07.826284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1336e5b-488a-4cba-872a-75477c6cb592 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:07.826951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1336e5b-488a-4cba-872a-75477c6cb592 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:07.827254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1336e5b-488a-4cba-872a-75477c6cb592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:07.829189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1336e5b-488a-4cba-872a-75477c6cb592 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:07.837863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 467/937] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Aug 18 16:52:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:07.843333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777e82d-8a14-4ea7-b71e-a16a44d4b038 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:07.852720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:07.855389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1336e5b-488a-4cba-872a-75477c6cb592 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:07.891925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:07.959665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1336e5b-488a-4cba-872a-75477c6cb592 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:07.965495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777e82d-8a14-4ea7-b71e-a16a44d4b038 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:08.005401 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:08.006262 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.006772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.007234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.007979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ffc01-3cbc-4da3-875b-031751faed4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:08.008210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:08.008650 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ffc01-3cbc-4da3-875b-031751faed4c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.008935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ffc01-3cbc-4da3-875b-031751faed4c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.009211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ffc01-3cbc-4da3-875b-031751faed4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.010320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:08.014612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: WARNING keystone.server.flask.common [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 16:52:08.021120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ffc01-3cbc-4da3-875b-031751faed4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:08.022918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ffc01-3cbc-4da3-875b-031751faed4c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:08.038858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.sql.core [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 16:52:08.038858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 16:52:08.038858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [parameters: {'id': 'cd72647f83794c55a23541af56820aaa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 16:52:08.038858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81515) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-7d0ffc01-3cbc-4da3-875b-031751faed4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:08.040632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:08.041812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:08.047361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:08.047361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:08.047361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:08.047361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 471/938] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:08.049208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ffc01-3cbc-4da3-875b-031751faed4c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cd72647f83794c55a23541af56820aaa.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cd72647f83794c55a23541af56820aaa. Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:52:08.054902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result.read() Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 16:52:08.055805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application yield resource Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise self.value Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application session.commit() Aug 18 16:52:08.056855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.session.flush() Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application compat.raise_( Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 16:52:08.057785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 16:52:08.060075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application result.read() Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:52:08.061682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [parameters: {'id': 'cd72647f83794c55a23541af56820aaa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:08.064333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:08.066271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cd72647f83794c55a23541af56820aaa. Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 468/939] 10.222.0.81 () {60 vars in 1140 bytes} [Thu Aug 18 16:52:07 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:08.068868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:08.119685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:08.173139 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ffc01-3cbc-4da3-875b-031751faed4c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:08.196557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:08.209415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467322ef-64ab-41dd-9617-2933ea4b840b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:08.210578 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f20aa-8784-4ce4-9632-30f64eeeaa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:08.211149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f20aa-8784-4ce4-9632-30f64eeeaa8a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.211439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f20aa-8784-4ce4-9632-30f64eeeaa8a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.211721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f20aa-8784-4ce4-9632-30f64eeeaa8a None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.212487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f20aa-8784-4ce4-9632-30f64eeeaa8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:08.212807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f20aa-8784-4ce4-9632-30f64eeeaa8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:08.214393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f20aa-8784-4ce4-9632-30f64eeeaa8a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:08.231999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 472/940] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:08.234158 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f20aa-8784-4ce4-9632-30f64eeeaa8a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:08.256668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e644e5-c79d-4c88-a3b1-e385440dbd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:08.257313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e644e5-c79d-4c88-a3b1-e385440dbd33 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.257592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e644e5-c79d-4c88-a3b1-e385440dbd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.257866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e644e5-c79d-4c88-a3b1-e385440dbd33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.264597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e644e5-c79d-4c88-a3b1-e385440dbd33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:08.266303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e644e5-c79d-4c88-a3b1-e385440dbd33 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f6e644e5-c79d-4c88-a3b1-e385440dbd33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:52:08.277352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:08.278447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:08.279583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:52:08.279583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:52:08.279583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:52:08.279583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:52:08.279583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:52:08.279583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:52:08.279583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:08.279583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:08.284017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 469/941] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:52:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:08.285414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af4a3-3dee-4fd1-aa8e-e0548d46a7af None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.285707 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af4a3-3dee-4fd1-aa8e-e0548d46a7af None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.285981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af4a3-3dee-4fd1-aa8e-e0548d46a7af None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.292521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 470/942] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:08.292521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2af4a3-3dee-4fd1-aa8e-e0548d46a7af None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:08.353060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f20aa-8784-4ce4-9632-30f64eeeaa8a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:08.372235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:08.394515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601661aa-0aaa-46f7-ad49-bfe4e067359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:08.395157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601661aa-0aaa-46f7-ad49-bfe4e067359d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.395447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601661aa-0aaa-46f7-ad49-bfe4e067359d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.395719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601661aa-0aaa-46f7-ad49-bfe4e067359d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.401644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2af4a3-3dee-4fd1-aa8e-e0548d46a7af None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:08.403028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601661aa-0aaa-46f7-ad49-bfe4e067359d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:08.404523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601661aa-0aaa-46f7-ad49-bfe4e067359d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-601661aa-0aaa-46f7-ad49-bfe4e067359d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:52:08.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:08.425401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 473/943] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Aug 18 16:52:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57ba4-157b-4c0c-aa0c-0a7a144d5823 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.426600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57ba4-157b-4c0c-aa0c-0a7a144d5823 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.427955 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b57ba4-157b-4c0c-aa0c-0a7a144d5823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.441118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-77b57ba4-157b-4c0c-aa0c-0a7a144d5823 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:08.442320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-77b57ba4-157b-4c0c-aa0c-0a7a144d5823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:08.454270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eece52e-b79c-4239-ad75-324c0547164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:08.454888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eece52e-b79c-4239-ad75-324c0547164d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.455172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eece52e-b79c-4239-ad75-324c0547164d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.455444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eece52e-b79c-4239-ad75-324c0547164d None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.456104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eece52e-b79c-4239-ad75-324c0547164d None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:08.456408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eece52e-b79c-4239-ad75-324c0547164d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:08.457987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eece52e-b79c-4239-ad75-324c0547164d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:08.476391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 471/944] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:52:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:08.482611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eece52e-b79c-4239-ad75-324c0547164d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:08.507706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:08.537005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 474/945] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:08.623354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eece52e-b79c-4239-ad75-324c0547164d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:08.659666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b921a82-45ab-4f55-a26a-50e84bc5898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:08.660294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b921a82-45ab-4f55-a26a-50e84bc5898f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.660605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b921a82-45ab-4f55-a26a-50e84bc5898f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.660880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b921a82-45ab-4f55-a26a-50e84bc5898f None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.661626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b921a82-45ab-4f55-a26a-50e84bc5898f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:08.661935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b921a82-45ab-4f55-a26a-50e84bc5898f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:08.663379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b921a82-45ab-4f55-a26a-50e84bc5898f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:08.682935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 472/946] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Aug 18 16:52:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:08.689175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b57ba4-157b-4c0c-aa0c-0a7a144d5823 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:08.796097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b57ba4-157b-4c0c-aa0c-0a7a144d5823 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:08.804524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:08.833913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71ebd8-8e52-4cf4-80b5-b53c0a6396f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:08.834560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ebd8-8e52-4cf4-80b5-b53c0a6396f6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.834846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ebd8-8e52-4cf4-80b5-b53c0a6396f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.835127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ebd8-8e52-4cf4-80b5-b53c0a6396f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.844260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b921a82-45ab-4f55-a26a-50e84bc5898f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:08.846755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71ebd8-8e52-4cf4-80b5-b53c0a6396f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:08.848479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71ebd8-8e52-4cf4-80b5-b53c0a6396f6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6d71ebd8-8e52-4cf4-80b5-b53c0a6396f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:08.864761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:08.865773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:08.866718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:08.866718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:08.866718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:08.866718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 475/947] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:08.873444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71ebd8-8e52-4cf4-80b5-b53c0a6396f6 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:08.922629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:08.958245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b921a82-45ab-4f55-a26a-50e84bc5898f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:08.995760 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726e428-ab73-4764-adc4-044328eff998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:08.996320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e428-ab73-4764-adc4-044328eff998 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:08.996651 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e428-ab73-4764-adc4-044328eff998 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:08.996931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e428-ab73-4764-adc4-044328eff998 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:08.997517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726e428-ab73-4764-adc4-044328eff998 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:08.998880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726e428-ab73-4764-adc4-044328eff998 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1726e428-ab73-4764-adc4-044328eff998 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:09.008560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:09.009599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:09.010467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:09.011250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71ebd8-8e52-4cf4-80b5-b53c0a6396f6 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:09.014519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 473/948] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:52:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:09.016348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6b1a-84f1-46de-81b2-7126f8122c92 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.016661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6b1a-84f1-46de-81b2-7126f8122c92 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.016949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6b1a-84f1-46de-81b2-7126f8122c92 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.020982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 474/949] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:09.020982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6b1a-84f1-46de-81b2-7126f8122c92 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:09.050421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950827a2-82eb-48c7-858a-98e80fa49133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:09.051057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950827a2-82eb-48c7-858a-98e80fa49133 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.051341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950827a2-82eb-48c7-858a-98e80fa49133 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.051628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950827a2-82eb-48c7-858a-98e80fa49133 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.052290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950827a2-82eb-48c7-858a-98e80fa49133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:09.052630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950827a2-82eb-48c7-858a-98e80fa49133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:09.054023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950827a2-82eb-48c7-858a-98e80fa49133 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:09.068833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 476/950] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:09.070191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb4fc9-f432-450d-8d0e-a226ffe5ec8c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.070485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb4fc9-f432-450d-8d0e-a226ffe5ec8c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.070762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb4fc9-f432-450d-8d0e-a226ffe5ec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.089379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4ceb4fc9-f432-450d-8d0e-a226ffe5ec8c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:09.090506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4ceb4fc9-f432-450d-8d0e-a226ffe5ec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:09.105381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:09.135655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6b1a-84f1-46de-81b2-7126f8122c92 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:09.163932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 477/951] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:09.165116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb4fc9-f432-450d-8d0e-a226ffe5ec8c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:09.184271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce145775-315a-4ef5-878c-0452c01e6066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:09.185372 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce145775-315a-4ef5-878c-0452c01e6066 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.185852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce145775-315a-4ef5-878c-0452c01e6066 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.186357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce145775-315a-4ef5-878c-0452c01e6066 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.187732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce145775-315a-4ef5-878c-0452c01e6066 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:09.188252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce145775-315a-4ef5-878c-0452c01e6066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:09.189927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce145775-315a-4ef5-878c-0452c01e6066 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:09.195656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 475/952] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Aug 18 16:52:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:09.195966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:09.201457 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce145775-315a-4ef5-878c-0452c01e6066 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:09.276854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb4fc9-f432-450d-8d0e-a226ffe5ec8c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:09.313532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ad633-44e7-4a28-9833-12727619619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:09.314172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ad633-44e7-4a28-9833-12727619619e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.314456 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ad633-44e7-4a28-9833-12727619619e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.314733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ad633-44e7-4a28-9833-12727619619e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.330571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ad633-44e7-4a28-9833-12727619619e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:09.332105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ad633-44e7-4a28-9833-12727619619e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:09.344529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce145775-315a-4ef5-878c-0452c01e6066 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-932ad633-44e7-4a28-9833-12727619619e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:52:09.348060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:09.349045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:09.349962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:52:09.349962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:52:09.349962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:52:09.349962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:52:09.349962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:52:09.349962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:52:09.349962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:09.349962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:09.349962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 478/953] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:09.354566 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ad633-44e7-4a28-9833-12727619619e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:09.366446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:09.392766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e69ec-2655-43f0-b457-e5c17fbebddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:09.393916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e69ec-2655-43f0-b457-e5c17fbebddc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.394417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e69ec-2655-43f0-b457-e5c17fbebddc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.395038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e69ec-2655-43f0-b457-e5c17fbebddc None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.395871 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e69ec-2655-43f0-b457-e5c17fbebddc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:09.396380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e69ec-2655-43f0-b457-e5c17fbebddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:09.397974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e69ec-2655-43f0-b457-e5c17fbebddc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:09.404038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 476/954] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Aug 18 16:52:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:09.409262 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e69ec-2655-43f0-b457-e5c17fbebddc None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:09.467642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ad633-44e7-4a28-9833-12727619619e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:09.476772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:09.511589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c36c1-881b-440b-b01a-16cc2cc0984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:09.512322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c36c1-881b-440b-b01a-16cc2cc0984a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.512748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c36c1-881b-440b-b01a-16cc2cc0984a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.513083 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c36c1-881b-440b-b01a-16cc2cc0984a None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.513845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c36c1-881b-440b-b01a-16cc2cc0984a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:09.514210 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c36c1-881b-440b-b01a-16cc2cc0984a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:09.516252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c36c1-881b-440b-b01a-16cc2cc0984a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:09.521951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e69ec-2655-43f0-b457-e5c17fbebddc None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:09.536201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 479/955] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:09.536201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c36c1-881b-440b-b01a-16cc2cc0984a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:09.558322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e5d49-0e15-4f9a-9887-f6171f8d24fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:09.558937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e5d49-0e15-4f9a-9887-f6171f8d24fb None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.559223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e5d49-0e15-4f9a-9887-f6171f8d24fb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.559544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e5d49-0e15-4f9a-9887-f6171f8d24fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.560261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e5d49-0e15-4f9a-9887-f6171f8d24fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:09.561719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e5d49-0e15-4f9a-9887-f6171f8d24fb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:09.596485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 477/956] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 16:52:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:09.596485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e5d49-0e15-4f9a-9887-f6171f8d24fb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:09.635914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:09.682004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c36c1-881b-440b-b01a-16cc2cc0984a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:09.740010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef99113-ceae-4a5c-b25d-b04229ba3e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:09.740010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99113-ceae-4a5c-b25d-b04229ba3e46 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.740010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99113-ceae-4a5c-b25d-b04229ba3e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.740010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99113-ceae-4a5c-b25d-b04229ba3e46 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.740634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef99113-ceae-4a5c-b25d-b04229ba3e46 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:09.744891 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef99113-ceae-4a5c-b25d-b04229ba3e46 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:09.747776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e5d49-0e15-4f9a-9887-f6171f8d24fb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6ef99113-ceae-4a5c-b25d-b04229ba3e46 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:09.753594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:09.754796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:52:09.755761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:09.758309 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 480/957] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:52:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:09.764921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef99113-ceae-4a5c-b25d-b04229ba3e46 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:09.767483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:09.789935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59966f-607b-4ffb-9881-5f408b6864da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:09.790281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59966f-607b-4ffb-9881-5f408b6864da None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.790557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59966f-607b-4ffb-9881-5f408b6864da None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.790828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59966f-607b-4ffb-9881-5f408b6864da None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/2b359b4974ab4d91895106a37d32fb6c/roles/b8bacb93751c4fcdb352c4557a49cbc7` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.794272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59966f-607b-4ffb-9881-5f408b6864da None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=2b359b4974ab4d91895106a37d32fb6c, role_id=b8bacb93751c4fcdb352c4557a49cbc7)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:09.796142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59966f-607b-4ffb-9881-5f408b6864da None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:09.811359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 478/958] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:52:09 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/2b359b4974ab4d91895106a37d32fb6c/roles/b8bacb93751c4fcdb352c4557a49cbc7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:52:09.904431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef99113-ceae-4a5c-b25d-b04229ba3e46 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:09.937057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:09.946779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8ffef-4e5d-4133-9d4a-164acdf9ee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:09.947474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8ffef-4e5d-4133-9d4a-164acdf9ee2e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:09.947805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8ffef-4e5d-4133-9d4a-164acdf9ee2e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:09.948088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8ffef-4e5d-4133-9d4a-164acdf9ee2e None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:09.948843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8ffef-4e5d-4133-9d4a-164acdf9ee2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:09.949210 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8ffef-4e5d-4133-9d4a-164acdf9ee2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:09.950615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8ffef-4e5d-4133-9d4a-164acdf9ee2e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:09.961960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 481/959] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:52:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:09.963429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59966f-607b-4ffb-9881-5f408b6864da None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:10.084705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59966f-607b-4ffb-9881-5f408b6864da None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:10.121728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7490-a71e-4f93-9b5d-8503d30dcbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:10.122351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7490-a71e-4f93-9b5d-8503d30dcbcf None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:10.122634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7490-a71e-4f93-9b5d-8503d30dcbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:10.122953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7490-a71e-4f93-9b5d-8503d30dcbcf None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:10.123598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c7490-a71e-4f93-9b5d-8503d30dcbcf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:10.123903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c7490-a71e-4f93-9b5d-8503d30dcbcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:10.125365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c7490-a71e-4f93-9b5d-8503d30dcbcf None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:10.134749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 479/960] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:52:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:10.576775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9c447-223d-4dcb-ab08-43f10a4a8500 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:10.577910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9c447-223d-4dcb-ab08-43f10a4a8500 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:10.578432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9c447-223d-4dcb-ab08-43f10a4a8500 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:10.580262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 482/961] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:10.585854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bdb2c-6033-4f43-b96f-e90e3fbebfcb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:10.586724 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bdb2c-6033-4f43-b96f-e90e3fbebfcb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:10.587211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bdb2c-6033-4f43-b96f-e90e3fbebfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:10.606523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3a3bdb2c-6033-4f43-b96f-e90e3fbebfcb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:10.608338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a3bdb2c-6033-4f43-b96f-e90e3fbebfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:10.648337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:10.683571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 480/962] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:10.970506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9c447-223d-4dcb-ab08-43f10a4a8500 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:11.090970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9c447-223d-4dcb-ab08-43f10a4a8500 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:11.127486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:11.128355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:11.128818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:11.129252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:11.129903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:11.131332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:11.133903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WARNING keystone.server.flask.common [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 16:52:11.148341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.sql.core [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 16:52:11.148341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 16:52:11.148341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [parameters: {'user_id': '650831bb6b0e45aaa6f1d0495658f6b8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 16:52:11.148341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81514) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result.read() Aug 18 16:52:11.165265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:52:11.166251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application yield resource Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application next(self.gen) Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise self.value Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application session.commit() Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 16:52:11.167438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.session.flush() Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application compat.raise_( Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 16:52:11.168376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 16:52:11.171721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application conn.query(q) Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application result.read() Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 16:52:11.174897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [parameters: {'user_id': '650831bb6b0e45aaa6f1d0495658f6b8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:11.180306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 16:52:11.181220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 16:52:11.182176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 16:52:11.182176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 16:52:11.182176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 16:52:11.182176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 16:52:11.182176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 16:52:11.182176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:11.182176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 483/963] 10.222.0.81 () {60 vars in 1131 bytes} [Thu Aug 18 16:52:10 2022] POST /identity/v3/users => generated 160 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:11.184141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bdb2c-6033-4f43-b96f-e90e3fbebfcb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:11.294477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bdb2c-6033-4f43-b96f-e90e3fbebfcb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:11.333590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfe36a-8e0b-4504-aecb-ae48f5baea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:11.334576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfe36a-8e0b-4504-aecb-ae48f5baea21 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:11.335042 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfe36a-8e0b-4504-aecb-ae48f5baea21 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:11.335511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfe36a-8e0b-4504-aecb-ae48f5baea21 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:11.343557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfe36a-8e0b-4504-aecb-ae48f5baea21 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:11.345980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfe36a-8e0b-4504-aecb-ae48f5baea21 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9fbfe36a-8e0b-4504-aecb-ae48f5baea21 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:52:11.359302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:11.360965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:11.362587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:11.362587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:11.362587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:52:11.362587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:52:11.362587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:52:11.362587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:52:11.362587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:52:11.362587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:52:11.362587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 16:52:11.362587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:11.369885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 481/964] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:52:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:11.371673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:11.438326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:11.487328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec121a-7c3e-4bb5-9be5-100201fcbc65 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:11.524943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d3272-098c-43e6-9998-65a63d2a2132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:11.525819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d3272-098c-43e6-9998-65a63d2a2132 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:11.526256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d3272-098c-43e6-9998-65a63d2a2132 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:11.526699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d3272-098c-43e6-9998-65a63d2a2132 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:11.527569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d3272-098c-43e6-9998-65a63d2a2132 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:11.528023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d3272-098c-43e6-9998-65a63d2a2132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:11.529843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d3272-098c-43e6-9998-65a63d2a2132 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:11.576696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 484/965] 10.222.0.81 () {56 vars in 1101 bytes} [Thu Aug 18 16:52:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:11.633999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e987ae8-53a8-40ef-9bfc-d82bd48fbdb4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:11.634887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e987ae8-53a8-40ef-9bfc-d82bd48fbdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:11.635316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e987ae8-53a8-40ef-9bfc-d82bd48fbdb4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:11.637105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 482/966] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:11.646927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee721d-fb97-40f8-bbcb-511a9d7684b3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:11.647987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee721d-fb97-40f8-bbcb-511a9d7684b3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:11.648527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee721d-fb97-40f8-bbcb-511a9d7684b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:11.669126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-75ee721d-fb97-40f8-bbcb-511a9d7684b3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:11.671124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-75ee721d-fb97-40f8-bbcb-511a9d7684b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:11.753928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 485/967] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:11.827470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284704ed-6933-4d4f-9cb5-06318b1c8621 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:11.827667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284704ed-6933-4d4f-9cb5-06318b1c8621 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:11.827953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284704ed-6933-4d4f-9cb5-06318b1c8621 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:11.829760 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 483/968] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:11.835256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dded9b1-8489-4146-9e24-6327ea4f9f19 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:11.835757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dded9b1-8489-4146-9e24-6327ea4f9f19 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:11.836206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dded9b1-8489-4146-9e24-6327ea4f9f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:11.855732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7dded9b1-8489-4146-9e24-6327ea4f9f19 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:11.856934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7dded9b1-8489-4146-9e24-6327ea4f9f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:11.895979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:11.932487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 486/969] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:12.027895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284704ed-6933-4d4f-9cb5-06318b1c8621 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:12.062707 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:12.134984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284704ed-6933-4d4f-9cb5-06318b1c8621 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:12.165538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d126157-a029-45f2-a641-43621b841382 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.165821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d126157-a029-45f2-a641-43621b841382 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.166094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d126157-a029-45f2-a641-43621b841382 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.167712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 487/970] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:52:12.173513 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3d65-62da-406e-8a94-f5b631fa39ce None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.173800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3d65-62da-406e-8a94-f5b631fa39ce None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.173908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44966b8-8580-4561-8a60-5533fab0f3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:12.174102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3d65-62da-406e-8a94-f5b631fa39ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.174925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44966b8-8580-4561-8a60-5533fab0f3fd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.175392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44966b8-8580-4561-8a60-5533fab0f3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.175837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44966b8-8580-4561-8a60-5533fab0f3fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.176626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44966b8-8580-4561-8a60-5533fab0f3fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:12.178218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44966b8-8580-4561-8a60-5533fab0f3fd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-c44966b8-8580-4561-8a60-5533fab0f3fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:12.189006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:12.190028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:12.190903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:12.192488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-74bc3d65-62da-406e-8a94-f5b631fa39ce None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:12.192980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 484/971] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:52:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:12.193633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-74bc3d65-62da-406e-8a94-f5b631fa39ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:12.198750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44966b8-8580-4561-8a60-5533fab0f3fd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:12.266744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 488/972] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:12.267763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3d65-62da-406e-8a94-f5b631fa39ce None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:12.294868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:12.303629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44966b8-8580-4561-8a60-5533fab0f3fd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:12.343310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fc13c-f6ce-4903-97cc-40ee4e005f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:12.343522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc13c-f6ce-4903-97cc-40ee4e005f09 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.343765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc13c-f6ce-4903-97cc-40ee4e005f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.343991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc13c-f6ce-4903-97cc-40ee4e005f09 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.344650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fc13c-f6ce-4903-97cc-40ee4e005f09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:12.344962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fc13c-f6ce-4903-97cc-40ee4e005f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:12.346337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fc13c-f6ce-4903-97cc-40ee4e005f09 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:12.351622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 485/973] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Aug 18 16:52:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:12.357100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fc13c-f6ce-4903-97cc-40ee4e005f09 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:12.381570 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3d65-62da-406e-8a94-f5b631fa39ce None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:12.383171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:12.419768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace243c5-baa1-4832-aa80-153457b1b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:12.420419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace243c5-baa1-4832-aa80-153457b1b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.420916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace243c5-baa1-4832-aa80-153457b1b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.421790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace243c5-baa1-4832-aa80-153457b1b1c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.433461 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace243c5-baa1-4832-aa80-153457b1b1c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ace243c5-baa1-4832-aa80-153457b1b1c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:12.440902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:12.442046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:12.445444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 489/974] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Aug 18 16:52:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:12.447775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace243c5-baa1-4832-aa80-153457b1b1c9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:12.482293 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fc13c-f6ce-4903-97cc-40ee4e005f09 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:12.519571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d8e3d-ad00-469b-8d52-fa8ef08bd7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:12.520409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d8e3d-ad00-469b-8d52-fa8ef08bd7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.520807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d8e3d-ad00-469b-8d52-fa8ef08bd7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.521191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d8e3d-ad00-469b-8d52-fa8ef08bd7d6 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.521900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d8e3d-ad00-469b-8d52-fa8ef08bd7d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:12.522991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d8e3d-ad00-469b-8d52-fa8ef08bd7d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:12.523740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d8e3d-ad00-469b-8d52-fa8ef08bd7d6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:12.529108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 486/975] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Aug 18 16:52:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:12.535227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d8e3d-ad00-469b-8d52-fa8ef08bd7d6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:12.554230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace243c5-baa1-4832-aa80-153457b1b1c9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:12.560187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:12.589598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c10023-f16c-4ed2-a356-22e30b338953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:12.590209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c10023-f16c-4ed2-a356-22e30b338953 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.590493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c10023-f16c-4ed2-a356-22e30b338953 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.590764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c10023-f16c-4ed2-a356-22e30b338953 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.591430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c10023-f16c-4ed2-a356-22e30b338953 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:12.591733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c10023-f16c-4ed2-a356-22e30b338953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:12.593167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c10023-f16c-4ed2-a356-22e30b338953 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:12.601167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 490/976] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Aug 18 16:52:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:12.601934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c10023-f16c-4ed2-a356-22e30b338953 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:12.630227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:12.635732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d8e3d-ad00-469b-8d52-fa8ef08bd7d6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:12.670978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa31f0-e9d9-49c2-a676-d5035ecf64a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:12.671647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa31f0-e9d9-49c2-a676-d5035ecf64a1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.671929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa31f0-e9d9-49c2-a676-d5035ecf64a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.672201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa31f0-e9d9-49c2-a676-d5035ecf64a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.672936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa31f0-e9d9-49c2-a676-d5035ecf64a1 None admin] RBAC: Adding query filter params (interface=admin, service_id=ee1a2405c46d40d3bfc59a93241f5b37, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:12.673249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa31f0-e9d9-49c2-a676-d5035ecf64a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:12.674609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa31f0-e9d9-49c2-a676-d5035ecf64a1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:12.679901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 487/977] 10.222.0.81 () {56 vars in 1249 bytes} [Thu Aug 18 16:52:12 2022] GET /identity/v3/endpoints?service_id=ee1a2405c46d40d3bfc59a93241f5b37&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:12.680518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa31f0-e9d9-49c2-a676-d5035ecf64a1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:12.706940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c10023-f16c-4ed2-a356-22e30b338953 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:12.743877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7e59-b835-475b-9268-84e73e1c8848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:12.744754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7e59-b835-475b-9268-84e73e1c8848 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.745132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7e59-b835-475b-9268-84e73e1c8848 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.745527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7e59-b835-475b-9268-84e73e1c8848 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.746235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf7e59-b835-475b-9268-84e73e1c8848 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:12.748205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf7e59-b835-475b-9268-84e73e1c8848 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:12.765067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 491/978] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:52:12 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:12.766645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7e59-b835-475b-9268-84e73e1c8848 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:12.774277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:12.792232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa31f0-e9d9-49c2-a676-d5035ecf64a1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:12.842660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf5a0f-2ca6-4395-90c7-72d83dd5dac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:12.843380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5a0f-2ca6-4395-90c7-72d83dd5dac0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.843660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5a0f-2ca6-4395-90c7-72d83dd5dac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.843936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5a0f-2ca6-4395-90c7-72d83dd5dac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.856786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf5a0f-2ca6-4395-90c7-72d83dd5dac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:12.858255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf5a0f-2ca6-4395-90c7-72d83dd5dac0 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-fccf5a0f-2ca6-4395-90c7-72d83dd5dac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:12.873508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:12.875131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:12.876122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:12.876122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:12.876122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:12.877676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:12.880692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 488/979] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:12.881684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf5a0f-2ca6-4395-90c7-72d83dd5dac0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:12.900783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7e59-b835-475b-9268-84e73e1c8848 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:12.940127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355a14e-e021-49ed-a60d-973bed316b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:12.941070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355a14e-e021-49ed-a60d-973bed316b0c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:12.941573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355a14e-e021-49ed-a60d-973bed316b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:12.941853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355a14e-e021-49ed-a60d-973bed316b0c None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:12.942467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355a14e-e021-49ed-a60d-973bed316b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:12.943854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355a14e-e021-49ed-a60d-973bed316b0c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:12.951626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 492/980] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Aug 18 16:52:12 2022] GET /identity/v3/services => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:52:12.998346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf5a0f-2ca6-4395-90c7-72d83dd5dac0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:13.036380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af6e9e-88e1-405f-98ec-ef0268692337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:13.037032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af6e9e-88e1-405f-98ec-ef0268692337 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:13.037316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af6e9e-88e1-405f-98ec-ef0268692337 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:13.037594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af6e9e-88e1-405f-98ec-ef0268692337 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:13.038259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af6e9e-88e1-405f-98ec-ef0268692337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:13.038559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af6e9e-88e1-405f-98ec-ef0268692337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:13.039965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af6e9e-88e1-405f-98ec-ef0268692337 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:13.042764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:13.056339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 489/981] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:13.062750 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355a14e-e021-49ed-a60d-973bed316b0c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:13.172841 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355a14e-e021-49ed-a60d-973bed316b0c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:13.208373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864814a-8247-47f2-9dcb-c3ad48da88c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:13.209343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864814a-8247-47f2-9dcb-c3ad48da88c1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:13.209794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864814a-8247-47f2-9dcb-c3ad48da88c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:13.210250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864814a-8247-47f2-9dcb-c3ad48da88c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:13.218136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864814a-8247-47f2-9dcb-c3ad48da88c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:13.219820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864814a-8247-47f2-9dcb-c3ad48da88c1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8864814a-8247-47f2-9dcb-c3ad48da88c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:52:13.231581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:13.232671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:13.234242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 493/982] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Aug 18 16:52:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:13.241423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af6e9e-88e1-405f-98ec-ef0268692337 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:13.346255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af6e9e-88e1-405f-98ec-ef0268692337 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:13.383387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdcaba-f4d9-42d5-87c0-1d88d60b802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:13.384003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcaba-f4d9-42d5-87c0-1d88d60b802a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:13.384285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcaba-f4d9-42d5-87c0-1d88d60b802a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:13.384659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcaba-f4d9-42d5-87c0-1d88d60b802a None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:13.385393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdcaba-f4d9-42d5-87c0-1d88d60b802a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:13.385701 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdcaba-f4d9-42d5-87c0-1d88d60b802a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:13.387130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdcaba-f4d9-42d5-87c0-1d88d60b802a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:13.405491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 490/983] 10.222.0.81 () {56 vars in 1149 bytes} [Thu Aug 18 16:52:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:13.411171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864814a-8247-47f2-9dcb-c3ad48da88c1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:13.423748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:13.516396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864814a-8247-47f2-9dcb-c3ad48da88c1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:13.550325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f726ecf-f774-4c35-b7c3-ca0ff0d1b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:13.550934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f726ecf-f774-4c35-b7c3-ca0ff0d1b911 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:13.551217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f726ecf-f774-4c35-b7c3-ca0ff0d1b911 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:13.551492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f726ecf-f774-4c35-b7c3-ca0ff0d1b911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:13.619387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f726ecf-f774-4c35-b7c3-ca0ff0d1b911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:13.620878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f726ecf-f774-4c35-b7c3-ca0ff0d1b911 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:13.631076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:13.731455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 494/984] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:13 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:52:13.732715 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdcaba-f4d9-42d5-87c0-1d88d60b802a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:13.793194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:13.838844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdcaba-f4d9-42d5-87c0-1d88d60b802a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:13.875587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2f041-f0c6-46e0-9f4e-7c6de58298a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:13.876232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2f041-f0c6-46e0-9f4e-7c6de58298a7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:13.876537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2f041-f0c6-46e0-9f4e-7c6de58298a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:13.876814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2f041-f0c6-46e0-9f4e-7c6de58298a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:13.887627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2f041-f0c6-46e0-9f4e-7c6de58298a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:13.889096 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2f041-f0c6-46e0-9f4e-7c6de58298a7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-88c2f041-f0c6-46e0-9f4e-7c6de58298a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:13.903968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:13.904976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:13.907106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:13.907106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:13.907106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:13.907106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 491/985] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:13.911194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f726ecf-f774-4c35-b7c3-ca0ff0d1b911 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:14.013815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f726ecf-f774-4c35-b7c3-ca0ff0d1b911 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:14.023535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:14.049571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43bbd-8ed2-4ce8-ae3e-31cfbf5d8b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:14.050221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43bbd-8ed2-4ce8-ae3e-31cfbf5d8b06 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:14.050647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43bbd-8ed2-4ce8-ae3e-31cfbf5d8b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:14.050899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43bbd-8ed2-4ce8-ae3e-31cfbf5d8b06 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:14.051645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43bbd-8ed2-4ce8-ae3e-31cfbf5d8b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:14.052022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43bbd-8ed2-4ce8-ae3e-31cfbf5d8b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:14.054842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43bbd-8ed2-4ce8-ae3e-31cfbf5d8b06 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:14.072694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 495/986] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:14.074140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2f041-f0c6-46e0-9f4e-7c6de58298a7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:14.177561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2f041-f0c6-46e0-9f4e-7c6de58298a7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:14.184641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:14.213405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b23ba-4e27-424a-9393-0d82bceb5bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:14.214047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b23ba-4e27-424a-9393-0d82bceb5bae None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:14.214332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b23ba-4e27-424a-9393-0d82bceb5bae None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:14.214609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b23ba-4e27-424a-9393-0d82bceb5bae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:14.221546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b23ba-4e27-424a-9393-0d82bceb5bae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:14.222911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b23ba-4e27-424a-9393-0d82bceb5bae None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d72b23ba-4e27-424a-9393-0d82bceb5bae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:52:14.234107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:14.235053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:14.235982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:52:14.235982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:52:14.235982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:52:14.235982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:52:14.235982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:52:14.235982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:52:14.235982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:14.235982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:14.237044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 492/987] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:14.241347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43bbd-8ed2-4ce8-ae3e-31cfbf5d8b06 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:14.344411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43bbd-8ed2-4ce8-ae3e-31cfbf5d8b06 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:14.378613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5a569-357b-42a3-8f70-f350193903dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:14.379375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5a569-357b-42a3-8f70-f350193903dc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:14.379765 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5a569-357b-42a3-8f70-f350193903dc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:14.380134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5a569-357b-42a3-8f70-f350193903dc None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:14.380975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5a569-357b-42a3-8f70-f350193903dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:14.381384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5a569-357b-42a3-8f70-f350193903dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:14.382923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5a569-357b-42a3-8f70-f350193903dc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:14.401087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 496/988] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:14.402543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b23ba-4e27-424a-9393-0d82bceb5bae None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:14.509071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b23ba-4e27-424a-9393-0d82bceb5bae None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:14.543087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6592b3-93ba-4e18-8f79-8d324abd84d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:14.543844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6592b3-93ba-4e18-8f79-8d324abd84d7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:14.544228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6592b3-93ba-4e18-8f79-8d324abd84d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:14.544665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6592b3-93ba-4e18-8f79-8d324abd84d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:14.545498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6592b3-93ba-4e18-8f79-8d324abd84d7 None admin] RBAC: Adding query filter params (role.id=b8bacb93751c4fcdb352c4557a49cbc7, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=2b359b4974ab4d91895106a37d32fb6c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:14.545913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6592b3-93ba-4e18-8f79-8d324abd84d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:14.547983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6592b3-93ba-4e18-8f79-8d324abd84d7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:14.560717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 493/989] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:52:14 2022] GET /identity/v3/role_assignments?user.id=2b359b4974ab4d91895106a37d32fb6c&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b8bacb93751c4fcdb352c4557a49cbc7 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:14.698993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93e6f6-98d8-4011-a873-191fdb829410 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:14.699438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93e6f6-98d8-4011-a873-191fdb829410 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:14.699819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93e6f6-98d8-4011-a873-191fdb829410 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:14.701239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 497/990] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:14.706854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ca27c-fb45-415e-8291-ed452034c73d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:14.707171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ca27c-fb45-415e-8291-ed452034c73d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:14.707452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ca27c-fb45-415e-8291-ed452034c73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:14.728450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-027ca27c-fb45-415e-8291-ed452034c73d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:14.729777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-027ca27c-fb45-415e-8291-ed452034c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:14.757111 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:14.802821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 494/991] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:14.900128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380325-70c6-4ec6-afe0-8d712246e050 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:14.900676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380325-70c6-4ec6-afe0-8d712246e050 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:14.900792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380325-70c6-4ec6-afe0-8d712246e050 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:14.902289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 498/992] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:14.908166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0d78-d3db-4c97-a1ea-64f42a01d1d2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:14.908489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0d78-d3db-4c97-a1ea-64f42a01d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:14.908769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0d78-d3db-4c97-a1ea-64f42a01d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:14.927241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e06e0d78-d3db-4c97-a1ea-64f42a01d1d2 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:14.928427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e06e0d78-d3db-4c97-a1ea-64f42a01d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:14.998821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 495/993] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:15.072271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00380325-70c6-4ec6-afe0-8d712246e050 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:15.102079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:15.176851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00380325-70c6-4ec6-afe0-8d712246e050 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:15.215089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8606-e206-4d66-bc18-a4918e6fe54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:15.215731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8606-e206-4d66-bc18-a4918e6fe54b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:15.216068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8606-e206-4d66-bc18-a4918e6fe54b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:15.216282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8606-e206-4d66-bc18-a4918e6fe54b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:15.216928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8606-e206-4d66-bc18-a4918e6fe54b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:15.218882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8606-e206-4d66-bc18-a4918e6fe54b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a9df8606-e206-4d66-bc18-a4918e6fe54b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:15.228006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:15.229230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:52:15.230330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:15.232893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 499/994] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:52:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:15.234959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e0d78-d3db-4c97-a1ea-64f42a01d1d2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:15.267130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8606-e206-4d66-bc18-a4918e6fe54b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:15.366526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:15.377848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e0d78-d3db-4c97-a1ea-64f42a01d1d2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:15.395281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:15.406099 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8606-e206-4d66-bc18-a4918e6fe54b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:15.426015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bc142-4fe3-427a-bcdd-a3074d565305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:15.426629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bc142-4fe3-427a-bcdd-a3074d565305 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:15.426909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bc142-4fe3-427a-bcdd-a3074d565305 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:15.427182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bc142-4fe3-427a-bcdd-a3074d565305 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:15.427811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bc142-4fe3-427a-bcdd-a3074d565305 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:15.428111 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bc142-4fe3-427a-bcdd-a3074d565305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:15.429517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bc142-4fe3-427a-bcdd-a3074d565305 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:15.439221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 496/995] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:52:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:15.440142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bc142-4fe3-427a-bcdd-a3074d565305 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:15.450438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98b9f-d48f-4a29-b655-c5bc559e4e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:15.451781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98b9f-d48f-4a29-b655-c5bc559e4e76 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:15.452253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98b9f-d48f-4a29-b655-c5bc559e4e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:15.453624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98b9f-d48f-4a29-b655-c5bc559e4e76 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:15.454728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab98b9f-d48f-4a29-b655-c5bc559e4e76 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:15.456308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab98b9f-d48f-4a29-b655-c5bc559e4e76 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-0ab98b9f-d48f-4a29-b655-c5bc559e4e76 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:15.469729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:15.471041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 16:52:15.471948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:15.476806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 500/996] 10.222.0.81 () {56 vars in 1126 bytes} [Thu Aug 18 16:52:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:15.481302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98b9f-d48f-4a29-b655-c5bc559e4e76 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:15.572428 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bc142-4fe3-427a-bcdd-a3074d565305 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:15.609033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab98b9f-d48f-4a29-b655-c5bc559e4e76 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:15.615654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f416121-496e-460f-94e2-ab5cbd4e3707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:15.616276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416121-496e-460f-94e2-ab5cbd4e3707 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:15.616582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416121-496e-460f-94e2-ab5cbd4e3707 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:15.616925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f416121-496e-460f-94e2-ab5cbd4e3707 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:15.617664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f416121-496e-460f-94e2-ab5cbd4e3707 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:15.617970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f416121-496e-460f-94e2-ab5cbd4e3707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:15.619448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f416121-496e-460f-94e2-ab5cbd4e3707 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:15.630972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 497/997] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:52:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:15.631966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f416121-496e-460f-94e2-ab5cbd4e3707 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:15.653550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048acce8-0279-4aab-a8e6-3bb4d75668c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:15.654751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048acce8-0279-4aab-a8e6-3bb4d75668c7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:15.655276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048acce8-0279-4aab-a8e6-3bb4d75668c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:15.655869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048acce8-0279-4aab-a8e6-3bb4d75668c7 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:15.656772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048acce8-0279-4aab-a8e6-3bb4d75668c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:15.657473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048acce8-0279-4aab-a8e6-3bb4d75668c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:15.659000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:15.659666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048acce8-0279-4aab-a8e6-3bb4d75668c7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:15.670401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 501/998] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Aug 18 16:52:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:15.672845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048acce8-0279-4aab-a8e6-3bb4d75668c7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:15.707051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:15.767639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f416121-496e-460f-94e2-ab5cbd4e3707 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:15.808174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d928b-40de-4b8d-bbf0-4b57ee2026c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:15.808824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d928b-40de-4b8d-bbf0-4b57ee2026c2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:15.809108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d928b-40de-4b8d-bbf0-4b57ee2026c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:15.809380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d928b-40de-4b8d-bbf0-4b57ee2026c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:15.810159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d928b-40de-4b8d-bbf0-4b57ee2026c2 None admin] RBAC: Adding query filter params (interface=public, service_id=d71de2fc55974add90060884967528a2, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:15.810494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d928b-40de-4b8d-bbf0-4b57ee2026c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:15.812508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d928b-40de-4b8d-bbf0-4b57ee2026c2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:15.818325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 498/999] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Aug 18 16:52:15 2022] GET /identity/v3/endpoints?service_id=d71de2fc55974add90060884967528a2&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:15.823811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d928b-40de-4b8d-bbf0-4b57ee2026c2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:15.824043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048acce8-0279-4aab-a8e6-3bb4d75668c7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:15.860785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540e790-28d5-4ae4-849a-6cf6d2ca1f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:15.861401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e790-28d5-4ae4-849a-6cf6d2ca1f8b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:15.861686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e790-28d5-4ae4-849a-6cf6d2ca1f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:15.861961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e790-28d5-4ae4-849a-6cf6d2ca1f8b None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:15.863164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540e790-28d5-4ae4-849a-6cf6d2ca1f8b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:15.863164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540e790-28d5-4ae4-849a-6cf6d2ca1f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:15.864535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540e790-28d5-4ae4-849a-6cf6d2ca1f8b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:15.869688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 502/1000] 10.222.0.81 () {56 vars in 1122 bytes} [Thu Aug 18 16:52:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:15.875611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540e790-28d5-4ae4-849a-6cf6d2ca1f8b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:15.913943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:15.935007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d928b-40de-4b8d-bbf0-4b57ee2026c2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:15.967946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:15.971286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f432557-f70c-4450-b1b0-173335717ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:15.972009 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432557-f70c-4450-b1b0-173335717ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:15.972482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432557-f70c-4450-b1b0-173335717ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:15.972690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432557-f70c-4450-b1b0-173335717ab3 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:15.973293 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f432557-f70c-4450-b1b0-173335717ab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:15.974655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f432557-f70c-4450-b1b0-173335717ab3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:15.992501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 499/1001] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Aug 18 16:52:15 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:52:15.996650 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540e790-28d5-4ae4-849a-6cf6d2ca1f8b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:16.038072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1e275-6a7e-48c2-bb54-b482445fb581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:16.038872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1e275-6a7e-48c2-bb54-b482445fb581 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:16.039250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1e275-6a7e-48c2-bb54-b482445fb581 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:16.039647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1e275-6a7e-48c2-bb54-b482445fb581 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:16.040428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1e275-6a7e-48c2-bb54-b482445fb581 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:16.041962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1e275-6a7e-48c2-bb54-b482445fb581 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:16.061256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 503/1002] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 16:52:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:52:16.497764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d590f8-fa8d-4876-b73e-dd961cd660f3 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:16.498178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d590f8-fa8d-4876-b73e-dd961cd660f3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:16.498362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d590f8-fa8d-4876-b73e-dd961cd660f3 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:16.499843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 500/1003] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:16.504909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dd00a-6c16-4476-a283-5bd2f1e77e50 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:16.505196 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dd00a-6c16-4476-a283-5bd2f1e77e50 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:16.505470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dd00a-6c16-4476-a283-5bd2f1e77e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:16.523386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-da1dd00a-6c16-4476-a283-5bd2f1e77e50 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:16.524610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-da1dd00a-6c16-4476-a283-5bd2f1e77e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:16.598732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 504/1004] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:16 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:16.866442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d590f8-fa8d-4876-b73e-dd961cd660f3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:16.973933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d590f8-fa8d-4876-b73e-dd961cd660f3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:17.007631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766acbd-008f-4493-b926-162dae1f33a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:17.008266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766acbd-008f-4493-b926-162dae1f33a7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:17.008566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766acbd-008f-4493-b926-162dae1f33a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:17.008841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766acbd-008f-4493-b926-162dae1f33a7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:17.009415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766acbd-008f-4493-b926-162dae1f33a7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:17.010767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766acbd-008f-4493-b926-162dae1f33a7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f766acbd-008f-4493-b926-162dae1f33a7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:17.020109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:17.021383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:52:17.022674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:17.024824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 501/1005] 10.222.0.81 () {56 vars in 1105 bytes} [Thu Aug 18 16:52:16 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:17.027128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dd00a-6c16-4476-a283-5bd2f1e77e50 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:17.103335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:17.138484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dd00a-6c16-4476-a283-5bd2f1e77e50 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:17.175640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798b1e1-5508-448f-bff7-b98a44d5cb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:17.176299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798b1e1-5508-448f-bff7-b98a44d5cb5d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:17.176611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798b1e1-5508-448f-bff7-b98a44d5cb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:17.176890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798b1e1-5508-448f-bff7-b98a44d5cb5d None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:17.177523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798b1e1-5508-448f-bff7-b98a44d5cb5d None admin] RBAC: Adding query filter params (name=image) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:17.177904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798b1e1-5508-448f-bff7-b98a44d5cb5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:17.179347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798b1e1-5508-448f-bff7-b98a44d5cb5d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:17.189411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 505/1006] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:17.190569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766acbd-008f-4493-b926-162dae1f33a7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:17.207358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:17.300950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766acbd-008f-4493-b926-162dae1f33a7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:17.336075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04619fb-ced1-468a-b5b5-dd20839e6838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:17.336704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04619fb-ced1-468a-b5b5-dd20839e6838 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:17.336987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04619fb-ced1-468a-b5b5-dd20839e6838 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:17.337260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04619fb-ced1-468a-b5b5-dd20839e6838 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:17.337883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04619fb-ced1-468a-b5b5-dd20839e6838 None admin] RBAC: Adding query filter params (type=image) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:17.338186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04619fb-ced1-468a-b5b5-dd20839e6838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:17.339542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04619fb-ced1-468a-b5b5-dd20839e6838 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:17.344391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 502/1007] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:17.915923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee05c2-114f-4116-8baa-1a5399f00972 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:17.916244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee05c2-114f-4116-8baa-1a5399f00972 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:17.916496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee05c2-114f-4116-8baa-1a5399f00972 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:17.918045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 506/1008] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:17.923095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9262a3-cd05-44d7-b071-d777ea796499 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:17.923546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9262a3-cd05-44d7-b071-d777ea796499 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:17.923711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9262a3-cd05-44d7-b071-d777ea796499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:17.942271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7b9262a3-cd05-44d7-b071-d777ea796499 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:17.943466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7b9262a3-cd05-44d7-b071-d777ea796499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:17.983930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae374-154a-4d96-bfbb-71d58ef00bdb None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:17.984262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae374-154a-4d96-bfbb-71d58ef00bdb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:17.984510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae374-154a-4d96-bfbb-71d58ef00bdb None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:17.985993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 507/1009] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:17.991153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa9593-35e3-4ab1-8509-d79254fec0c5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:17.991446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa9593-35e3-4ab1-8509-d79254fec0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:17.991721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa9593-35e3-4ab1-8509-d79254fec0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:18.010081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-bcfa9593-35e3-4ab1-8509-d79254fec0c5 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:18.011269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bcfa9593-35e3-4ab1-8509-d79254fec0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:18.014602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 503/1010] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:18.082309 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 508/1011] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:18.285277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9262a3-cd05-44d7-b071-d777ea796499 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:18.288409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:18.349544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa9593-35e3-4ab1-8509-d79254fec0c5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:18.395812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9262a3-cd05-44d7-b071-d777ea796499 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:18.417929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:18.438202 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c2643-082a-4026-9437-867f4ea589b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:18.438957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c2643-082a-4026-9437-867f4ea589b7 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:18.439233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c2643-082a-4026-9437-867f4ea589b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:18.439522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c2643-082a-4026-9437-867f4ea589b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:18.440077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c2643-082a-4026-9437-867f4ea589b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:18.441501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c2643-082a-4026-9437-867f4ea589b7 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-ec9c2643-082a-4026-9437-867f4ea589b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:18.451198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:18.452272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:18.453660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 504/1012] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:52:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:18.458257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c2643-082a-4026-9437-867f4ea589b7 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:18.464870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa9593-35e3-4ab1-8509-d79254fec0c5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:18.504596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a71b4-25a9-4a94-8989-ccef101e4a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:18.505377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a71b4-25a9-4a94-8989-ccef101e4a3b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:18.505661 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a71b4-25a9-4a94-8989-ccef101e4a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:18.505929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a71b4-25a9-4a94-8989-ccef101e4a3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:18.507145 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a71b4-25a9-4a94-8989-ccef101e4a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:18.509003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a71b4-25a9-4a94-8989-ccef101e4a3b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:18.510671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 509/1013] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:18.516229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a71b4-25a9-4a94-8989-ccef101e4a3b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:18.529041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:18.564153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c2643-082a-4026-9437-867f4ea589b7 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:18.601837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b62bb7-7a16-4a42-a1c2-c8731c887535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:18.602798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b62bb7-7a16-4a42-a1c2-c8731c887535 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:18.603125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b62bb7-7a16-4a42-a1c2-c8731c887535 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:18.603392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b62bb7-7a16-4a42-a1c2-c8731c887535 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:18.603965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b62bb7-7a16-4a42-a1c2-c8731c887535 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:18.604266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b62bb7-7a16-4a42-a1c2-c8731c887535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:18.605656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b62bb7-7a16-4a42-a1c2-c8731c887535 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:18.611101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 505/1014] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:52:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:18.617773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b62bb7-7a16-4a42-a1c2-c8731c887535 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:18.628513 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a71b4-25a9-4a94-8989-ccef101e4a3b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:18.659038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:18.664717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2119-87fe-4345-99a8-3cecabbb570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:18.665332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2119-87fe-4345-99a8-3cecabbb570b None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:18.665613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2119-87fe-4345-99a8-3cecabbb570b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:18.665887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2119-87fe-4345-99a8-3cecabbb570b None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:18.666533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2119-87fe-4345-99a8-3cecabbb570b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:18.668022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2119-87fe-4345-99a8-3cecabbb570b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:18.700651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 510/1015] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:52:18 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:52:18.734354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b62bb7-7a16-4a42-a1c2-c8731c887535 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:18.767039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:18.773426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea1e09-bf7b-4d75-a925-dde5d7ec86a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:18.774139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea1e09-bf7b-4d75-a925-dde5d7ec86a9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:18.774422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea1e09-bf7b-4d75-a925-dde5d7ec86a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:18.774699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea1e09-bf7b-4d75-a925-dde5d7ec86a9 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:18.775343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea1e09-bf7b-4d75-a925-dde5d7ec86a9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:18.775647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea1e09-bf7b-4d75-a925-dde5d7ec86a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:18.777060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea1e09-bf7b-4d75-a925-dde5d7ec86a9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:18.788145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 506/1016] 10.222.0.81 () {56 vars in 1112 bytes} [Thu Aug 18 16:52:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:18.789231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2119-87fe-4345-99a8-3cecabbb570b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:18.898267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2119-87fe-4345-99a8-3cecabbb570b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:18.935364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64139c14-9edb-4a57-a386-6218edf3e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:18.935979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139c14-9edb-4a57-a386-6218edf3e16b None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:18.936260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139c14-9edb-4a57-a386-6218edf3e16b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:18.936679 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139c14-9edb-4a57-a386-6218edf3e16b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:18.937351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64139c14-9edb-4a57-a386-6218edf3e16b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:18.938733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64139c14-9edb-4a57-a386-6218edf3e16b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:18.959183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 511/1017] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 16:52:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:19.263264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd335c-eb10-48eb-b5a6-5d5c5e13c4ac None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:19.263822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd335c-eb10-48eb-b5a6-5d5c5e13c4ac None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:19.263822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd335c-eb10-48eb-b5a6-5d5c5e13c4ac None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:19.265279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 507/1018] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:19.270412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dcd97-9525-4364-8cb2-810024712b1d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:19.270825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dcd97-9525-4364-8cb2-810024712b1d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:19.271010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dcd97-9525-4364-8cb2-810024712b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:19.289341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-413dcd97-9525-4364-8cb2-810024712b1d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:19.290532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-413dcd97-9525-4364-8cb2-810024712b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:19.326000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:19.371081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 512/1019] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:19 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:19.641617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd335c-eb10-48eb-b5a6-5d5c5e13c4ac None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:19.751223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd335c-eb10-48eb-b5a6-5d5c5e13c4ac None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:19.785611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c539d-0ba9-42c1-b731-cc526f46cc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:19.786216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c539d-0ba9-42c1-b731-cc526f46cc32 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:19.786493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c539d-0ba9-42c1-b731-cc526f46cc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:19.786767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c539d-0ba9-42c1-b731-cc526f46cc32 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:19.787411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c539d-0ba9-42c1-b731-cc526f46cc32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:19.788795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c539d-0ba9-42c1-b731-cc526f46cc32 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:19.805553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 508/1020] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:52:19 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:20.669120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c284b-cc36-47c6-a582-a666729adfa6 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:20.669706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c284b-cc36-47c6-a582-a666729adfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:20.669706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c284b-cc36-47c6-a582-a666729adfa6 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:20.671714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 513/1021] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:20.676897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63bf92-b243-4dee-99f6-cf1c62b636ce None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:20.677313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63bf92-b243-4dee-99f6-cf1c62b636ce None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:20.677499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63bf92-b243-4dee-99f6-cf1c62b636ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:20.695548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3a63bf92-b243-4dee-99f6-cf1c62b636ce None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:20.696751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a63bf92-b243-4dee-99f6-cf1c62b636ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:20.760287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:20.789355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 509/1022] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:20.961002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe104384-a740-4d50-9213-d2a8dc7c922d None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:20.961207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe104384-a740-4d50-9213-d2a8dc7c922d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:20.961481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe104384-a740-4d50-9213-d2a8dc7c922d None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:20.963804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 514/1023] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:20.969145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d2af8-6af9-43eb-b11e-f8f79d69f00d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:20.969511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d2af8-6af9-43eb-b11e-f8f79d69f00d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:20.969867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d2af8-6af9-43eb-b11e-f8f79d69f00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:20.988024 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-275d2af8-6af9-43eb-b11e-f8f79d69f00d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:20.989506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-275d2af8-6af9-43eb-b11e-f8f79d69f00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:21.058242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 510/1024] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:21.059721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe104384-a740-4d50-9213-d2a8dc7c922d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:21.163971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe104384-a740-4d50-9213-d2a8dc7c922d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:21.198405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a854865-1661-4e1c-ae9e-cdc759691e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:21.199044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a854865-1661-4e1c-ae9e-cdc759691e0e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:21.199328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a854865-1661-4e1c-ae9e-cdc759691e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:21.199601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a854865-1661-4e1c-ae9e-cdc759691e0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:21.200743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a854865-1661-4e1c-ae9e-cdc759691e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:21.202711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a854865-1661-4e1c-ae9e-cdc759691e0e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:21.208484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 515/1025] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:21.210294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d2af8-6af9-43eb-b11e-f8f79d69f00d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:21.313005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d2af8-6af9-43eb-b11e-f8f79d69f00d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:21.324411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a854865-1661-4e1c-ae9e-cdc759691e0e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:21.327868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:21.353980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6654c3-f25c-4de3-9ffe-562ee49a051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:21.354603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6654c3-f25c-4de3-9ffe-562ee49a051c None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:21.354886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6654c3-f25c-4de3-9ffe-562ee49a051c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:21.355169 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6654c3-f25c-4de3-9ffe-562ee49a051c None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:21.355811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6654c3-f25c-4de3-9ffe-562ee49a051c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:21.357292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6654c3-f25c-4de3-9ffe-562ee49a051c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:21.364423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:21.386082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 511/1026] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:52:21 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:52:21.453318 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a854865-1661-4e1c-ae9e-cdc759691e0e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:21.492402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62d4b3-6842-479f-92cc-fa3b5ace132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:21.493092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62d4b3-6842-479f-92cc-fa3b5ace132a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:21.493377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62d4b3-6842-479f-92cc-fa3b5ace132a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:21.493653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62d4b3-6842-479f-92cc-fa3b5ace132a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:21.505931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62d4b3-6842-479f-92cc-fa3b5ace132a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5d62d4b3-6842-479f-92cc-fa3b5ace132a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:21.510801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:21.511826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:21.517248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 516/1027] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Aug 18 16:52:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:21.518983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6654c3-f25c-4de3-9ffe-562ee49a051c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:21.634814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6654c3-f25c-4de3-9ffe-562ee49a051c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:21.671767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0d4a6-6152-4db9-b56d-85d9efd70255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:21.672388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0d4a6-6152-4db9-b56d-85d9efd70255 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:21.672699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0d4a6-6152-4db9-b56d-85d9efd70255 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:21.672980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0d4a6-6152-4db9-b56d-85d9efd70255 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:21.673662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0d4a6-6152-4db9-b56d-85d9efd70255 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:21.673966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0d4a6-6152-4db9-b56d-85d9efd70255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:21.675351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0d4a6-6152-4db9-b56d-85d9efd70255 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:21.684273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 512/1028] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Aug 18 16:52:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:21.691144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62d4b3-6842-479f-92cc-fa3b5ace132a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:21.732841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e33e1-2ba7-406b-a69c-733c025e3131 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:21.733382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e33e1-2ba7-406b-a69c-733c025e3131 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:21.733661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e33e1-2ba7-406b-a69c-733c025e3131 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:21.737441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 513/1029] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:52:21.740923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edaf21-4792-4e74-9d55-54c6a75b41ca None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:21.741103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edaf21-4792-4e74-9d55-54c6a75b41ca None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:21.741388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edaf21-4792-4e74-9d55-54c6a75b41ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:21.760886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-02edaf21-4792-4e74-9d55-54c6a75b41ca None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:21.762094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-02edaf21-4792-4e74-9d55-54c6a75b41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:21.788873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:21.803656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:21.813539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62d4b3-6842-479f-92cc-fa3b5ace132a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:21.845502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 514/1030] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:21.849478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951145f8-f96c-40c1-91dc-4387b9f2c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:21.850117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951145f8-f96c-40c1-91dc-4387b9f2c5cc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:21.850402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951145f8-f96c-40c1-91dc-4387b9f2c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:21.850674 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951145f8-f96c-40c1-91dc-4387b9f2c5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:21.862740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951145f8-f96c-40c1-91dc-4387b9f2c5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:21.864663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951145f8-f96c-40c1-91dc-4387b9f2c5cc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-951145f8-f96c-40c1-91dc-4387b9f2c5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:21.879844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:21.881035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:21.881984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:21.881984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:21.881984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:21.881984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 517/1031] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:21.887154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edaf21-4792-4e74-9d55-54c6a75b41ca None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:21.992839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edaf21-4792-4e74-9d55-54c6a75b41ca None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:22.027765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7b92f-8ac6-46b9-876d-7534afea7b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:22.028379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7b92f-8ac6-46b9-876d-7534afea7b4e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:22.028740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7b92f-8ac6-46b9-876d-7534afea7b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:22.028951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7b92f-8ac6-46b9-876d-7534afea7b4e None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:22.029591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7b92f-8ac6-46b9-876d-7534afea7b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:22.029895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7b92f-8ac6-46b9-876d-7534afea7b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:22.031294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7b92f-8ac6-46b9-876d-7534afea7b4e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:22.047566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 515/1032] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:22.049308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951145f8-f96c-40c1-91dc-4387b9f2c5cc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:22.135577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7b92f-8ac6-46b9-876d-7534afea7b4e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:22.157786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:22.163109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951145f8-f96c-40c1-91dc-4387b9f2c5cc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:22.199855 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038aea0-8f3b-4bc1-9a49-e87df5dfc331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:22.200506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038aea0-8f3b-4bc1-9a49-e87df5dfc331 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:22.200790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038aea0-8f3b-4bc1-9a49-e87df5dfc331 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:22.201061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038aea0-8f3b-4bc1-9a49-e87df5dfc331 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:22.208384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038aea0-8f3b-4bc1-9a49-e87df5dfc331 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:22.209854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038aea0-8f3b-4bc1-9a49-e87df5dfc331 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-4038aea0-8f3b-4bc1-9a49-e87df5dfc331 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:52:22.220922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:22.221958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:22.223441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 518/1033] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Aug 18 16:52:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:22.227851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038aea0-8f3b-4bc1-9a49-e87df5dfc331 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:22.238844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:22.248957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7b92f-8ac6-46b9-876d-7534afea7b4e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:22.284511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84b96b-844b-420b-b3bd-ac6cd46873ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:22.285155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84b96b-844b-420b-b3bd-ac6cd46873ef None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:22.285432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84b96b-844b-420b-b3bd-ac6cd46873ef None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:22.285702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84b96b-844b-420b-b3bd-ac6cd46873ef None admin] PATH_INFO: `/v3/services/image` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:22.286281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84b96b-844b-420b-b3bd-ac6cd46873ef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:22.287667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84b96b-844b-420b-b3bd-ac6cd46873ef None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-9b84b96b-844b-420b-b3bd-ac6cd46873ef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:22.296266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:22.297501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:22.298704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 516/1034] 10.222.0.81 () {56 vars in 1105 bytes} [Thu Aug 18 16:52:22 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:22.303798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84b96b-844b-420b-b3bd-ac6cd46873ef None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:22.348228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038aea0-8f3b-4bc1-9a49-e87df5dfc331 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:22.389488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf054dd-bbee-4221-b4e3-cdbf20b5ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:22.390691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf054dd-bbee-4221-b4e3-cdbf20b5ac41 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:22.390966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf054dd-bbee-4221-b4e3-cdbf20b5ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:22.391243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf054dd-bbee-4221-b4e3-cdbf20b5ac41 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:22.391982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf054dd-bbee-4221-b4e3-cdbf20b5ac41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:22.392302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf054dd-bbee-4221-b4e3-cdbf20b5ac41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:22.393752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf054dd-bbee-4221-b4e3-cdbf20b5ac41 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:22.400606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:22.412687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 519/1035] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Aug 18 16:52:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:22.418152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf054dd-bbee-4221-b4e3-cdbf20b5ac41 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:22.420180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84b96b-844b-420b-b3bd-ac6cd46873ef None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:22.458774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343c24b-bb47-4417-a26d-f798c55d342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:22.459405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343c24b-bb47-4417-a26d-f798c55d342e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:22.459689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343c24b-bb47-4417-a26d-f798c55d342e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:22.459971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343c24b-bb47-4417-a26d-f798c55d342e None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:22.460647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343c24b-bb47-4417-a26d-f798c55d342e None admin] RBAC: Adding query filter params (name=image) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:22.460956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343c24b-bb47-4417-a26d-f798c55d342e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:22.462331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343c24b-bb47-4417-a26d-f798c55d342e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:22.468505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 517/1036] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:22.474359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343c24b-bb47-4417-a26d-f798c55d342e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:22.491674 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:22.534814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf054dd-bbee-4221-b4e3-cdbf20b5ac41 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:22.573186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477f5c1-d161-4291-a956-4231457680f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:22.573808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f5c1-d161-4291-a956-4231457680f1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:22.574094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f5c1-d161-4291-a956-4231457680f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:22.574372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f5c1-d161-4291-a956-4231457680f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:22.594642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343c24b-bb47-4417-a26d-f798c55d342e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:22.630671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea2bd-866b-4789-b33c-48656179e271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:22.631345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea2bd-866b-4789-b33c-48656179e271 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:22.631569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea2bd-866b-4789-b33c-48656179e271 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:22.631841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea2bd-866b-4789-b33c-48656179e271 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:22.632492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea2bd-866b-4789-b33c-48656179e271 None admin] RBAC: Adding query filter params (type=image) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:22.632802 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea2bd-866b-4789-b33c-48656179e271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:22.634163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea2bd-866b-4789-b33c-48656179e271 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:22.644681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 518/1037] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:22.645968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea2bd-866b-4789-b33c-48656179e271 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:22.648097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477f5c1-d161-4291-a956-4231457680f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:22.649575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477f5c1-d161-4291-a956-4231457680f1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:22.663094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:22.712937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:22.760424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 520/1038] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:22 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:52:22.766553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477f5c1-d161-4291-a956-4231457680f1 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:22.768211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea2bd-866b-4789-b33c-48656179e271 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:22.805762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb513b87-0762-4ba7-a0ea-935bdb889979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:22.806383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb513b87-0762-4ba7-a0ea-935bdb889979 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:22.806666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb513b87-0762-4ba7-a0ea-935bdb889979 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:22.807608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb513b87-0762-4ba7-a0ea-935bdb889979 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:22.807730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb513b87-0762-4ba7-a0ea-935bdb889979 None admin] RBAC: Adding query filter params (interface=public, service_id=5167a6f8b62b41599750cc0dfa32ac1a, region_id=RegionOne) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:22.807947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb513b87-0762-4ba7-a0ea-935bdb889979 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:22.809359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb513b87-0762-4ba7-a0ea-935bdb889979 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:22.815337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 519/1039] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Aug 18 16:52:22 2022] GET /identity/v3/endpoints?service_id=5167a6f8b62b41599750cc0dfa32ac1a&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:22.821607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb513b87-0762-4ba7-a0ea-935bdb889979 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:22.884229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477f5c1-d161-4291-a956-4231457680f1 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:22.905705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:22.919545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a32975-c877-4395-8b9a-9896c82ada44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:22.920089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a32975-c877-4395-8b9a-9896c82ada44 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:22.920374 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a32975-c877-4395-8b9a-9896c82ada44 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:22.920663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a32975-c877-4395-8b9a-9896c82ada44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:22.931080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb513b87-0762-4ba7-a0ea-935bdb889979 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:22.931527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a32975-c877-4395-8b9a-9896c82ada44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:22.933026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a32975-c877-4395-8b9a-9896c82ada44 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-c1a32975-c877-4395-8b9a-9896c82ada44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:22.948776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:22.949865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:22.950794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:22.950794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:22.950794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:22.950794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 521/1040] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:22.955700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a32975-c877-4395-8b9a-9896c82ada44 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:22.970194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a6a5a-46eb-4f1f-b106-9f3297f1ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:22.970818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a6a5a-46eb-4f1f-b106-9f3297f1ae12 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:22.971098 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a6a5a-46eb-4f1f-b106-9f3297f1ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:22.971374 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a6a5a-46eb-4f1f-b106-9f3297f1ae12 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:22.971980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a6a5a-46eb-4f1f-b106-9f3297f1ae12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:22.973371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a6a5a-46eb-4f1f-b106-9f3297f1ae12 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:22.975348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:22.980690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 520/1041] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Aug 18 16:52:22 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:52:23.075798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a32975-c877-4395-8b9a-9896c82ada44 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:23.112394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b56a7-85f9-40e4-a73e-ec20b7eae034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:23.112938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b56a7-85f9-40e4-a73e-ec20b7eae034 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:23.113512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b56a7-85f9-40e4-a73e-ec20b7eae034 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:23.113748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b56a7-85f9-40e4-a73e-ec20b7eae034 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:23.114398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b56a7-85f9-40e4-a73e-ec20b7eae034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:23.114699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b56a7-85f9-40e4-a73e-ec20b7eae034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:23.116072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b56a7-85f9-40e4-a73e-ec20b7eae034 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:23.130056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 522/1042] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:23.135805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a6a5a-46eb-4f1f-b106-9f3297f1ae12 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:23.240590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a6a5a-46eb-4f1f-b106-9f3297f1ae12 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:23.274787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c5c45-6d5a-44f5-b8df-4b45a59ebf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:23.275418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c5c45-6d5a-44f5-b8df-4b45a59ebf26 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:23.275699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c5c45-6d5a-44f5-b8df-4b45a59ebf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:23.275974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c5c45-6d5a-44f5-b8df-4b45a59ebf26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:23.282866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c5c45-6d5a-44f5-b8df-4b45a59ebf26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:23.284292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c5c45-6d5a-44f5-b8df-4b45a59ebf26 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:23.286872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5a3c5c45-6d5a-44f5-b8df-4b45a59ebf26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:52:23.297252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:23.298224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:23.299150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:52:23.299150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:52:23.299150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:52:23.299150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:52:23.299150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:52:23.299150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:52:23.299150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:23.299150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:23.299150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 521/1043] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:52:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:23.304398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b56a7-85f9-40e4-a73e-ec20b7eae034 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:23.375930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50de6-91cc-425c-be2d-ba2684b15bae None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:23.376213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50de6-91cc-425c-be2d-ba2684b15bae None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:23.376523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50de6-91cc-425c-be2d-ba2684b15bae None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:23.378013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 522/1044] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:23.383273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb86b8-d6d9-4d7f-8aaf-c3424686de59 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:23.383556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb86b8-d6d9-4d7f-8aaf-c3424686de59 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:23.383833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb86b8-d6d9-4d7f-8aaf-c3424686de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:23.385235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:23.403290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a7eb86b8-d6d9-4d7f-8aaf-c3424686de59 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:23.404401 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a7eb86b8-d6d9-4d7f-8aaf-c3424686de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:23.411400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b56a7-85f9-40e4-a73e-ec20b7eae034 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:23.450019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b7ab1-9716-41b7-944f-c042a60b13be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:23.450648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b7ab1-9716-41b7-944f-c042a60b13be None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:23.450931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b7ab1-9716-41b7-944f-c042a60b13be None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:23.451212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b7ab1-9716-41b7-944f-c042a60b13be None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:23.451945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b7ab1-9716-41b7-944f-c042a60b13be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:23.452259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b7ab1-9716-41b7-944f-c042a60b13be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:23.453751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b7ab1-9716-41b7-944f-c042a60b13be None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:23.466830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 523/1045] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:52:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:23.473098 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b7ab1-9716-41b7-944f-c042a60b13be None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:23.480706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 523/1046] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:23.582980 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b7ab1-9716-41b7-944f-c042a60b13be None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:23.617569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbff8a-3ad8-4941-a43b-2160a7f5fc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:23.618176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbff8a-3ad8-4941-a43b-2160a7f5fc8a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:23.618456 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbff8a-3ad8-4941-a43b-2160a7f5fc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:23.618729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbff8a-3ad8-4941-a43b-2160a7f5fc8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:23.619455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbff8a-3ad8-4941-a43b-2160a7f5fc8a None admin] RBAC: Adding query filter params (role.id=b8bacb93751c4fcdb352c4557a49cbc7, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=c425b390c8dc4d799270fdd095be78b4) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:23.619762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbff8a-3ad8-4941-a43b-2160a7f5fc8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:23.621210 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbff8a-3ad8-4941-a43b-2160a7f5fc8a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:23.625076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:23.628996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 524/1047] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:52:23 2022] GET /identity/v3/role_assignments?user.id=c425b390c8dc4d799270fdd095be78b4&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b8bacb93751c4fcdb352c4557a49cbc7 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:23.766613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb86b8-d6d9-4d7f-8aaf-c3424686de59 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:23.868227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb86b8-d6d9-4d7f-8aaf-c3424686de59 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:23.897585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:23.904680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c6656-f9c3-40b7-a1bf-a57db18f99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:23.905843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c6656-f9c3-40b7-a1bf-a57db18f99b6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:23.906121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c6656-f9c3-40b7-a1bf-a57db18f99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:23.906392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c6656-f9c3-40b7-a1bf-a57db18f99b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:23.916552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c6656-f9c3-40b7-a1bf-a57db18f99b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-2c5c6656-f9c3-40b7-a1bf-a57db18f99b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:23.921766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:23.922717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:23.923611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 524/1048] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:52:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:23.930561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbff8a-3ad8-4941-a43b-2160a7f5fc8a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:24.034334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbff8a-3ad8-4941-a43b-2160a7f5fc8a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:24.073755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cd5b4-0a11-425c-87fb-dec7bfc61028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:24.074375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cd5b4-0a11-425c-87fb-dec7bfc61028 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:24.074778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cd5b4-0a11-425c-87fb-dec7bfc61028 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:24.075130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cd5b4-0a11-425c-87fb-dec7bfc61028 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:24.075742 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cd5b4-0a11-425c-87fb-dec7bfc61028 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:24.076051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cd5b4-0a11-425c-87fb-dec7bfc61028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:24.078197 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cd5b4-0a11-425c-87fb-dec7bfc61028 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:24.093023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 525/1049] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:52:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:24.093877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c6656-f9c3-40b7-a1bf-a57db18f99b6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:24.201407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c6656-f9c3-40b7-a1bf-a57db18f99b6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:24.235875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303178ab-2a34-45b1-a480-83e7acd1ed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:24.236533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303178ab-2a34-45b1-a480-83e7acd1ed2b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:24.236814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303178ab-2a34-45b1-a480-83e7acd1ed2b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:24.237110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303178ab-2a34-45b1-a480-83e7acd1ed2b None admin] PATH_INFO: `/v3/users/b76928fb507d4752974f5959011c3f69` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:24.251509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303178ab-2a34-45b1-a480-83e7acd1ed2b None admin] RBAC: Authorizing `identity:get_user(user_id=b76928fb507d4752974f5959011c3f69)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:24.252967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303178ab-2a34-45b1-a480-83e7acd1ed2b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:24.254909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 525/1050] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:24 2022] GET /identity/v3/users/b76928fb507d4752974f5959011c3f69 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:24.260435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cd5b4-0a11-425c-87fb-dec7bfc61028 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:24.322076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:24.361701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cd5b4-0a11-425c-87fb-dec7bfc61028 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:24.395768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b985493-182c-4d06-9d69-2a9e85282792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:24.396375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b985493-182c-4d06-9d69-2a9e85282792 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:24.396682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b985493-182c-4d06-9d69-2a9e85282792 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:24.396953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b985493-182c-4d06-9d69-2a9e85282792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:24.470400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b985493-182c-4d06-9d69-2a9e85282792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:24.471775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b985493-182c-4d06-9d69-2a9e85282792 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:24.532002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:24.572976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 526/1051] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:24 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:52:24.578685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303178ab-2a34-45b1-a480-83e7acd1ed2b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:24.630143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:24.684131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303178ab-2a34-45b1-a480-83e7acd1ed2b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:24.719807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829eb4dc-e42e-44f0-9930-a185bd32583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:24.720819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eb4dc-e42e-44f0-9930-a185bd32583d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:24.721236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eb4dc-e42e-44f0-9930-a185bd32583d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:24.721649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eb4dc-e42e-44f0-9930-a185bd32583d None admin] PATH_INFO: `/v3/projects/30da536aaf80437da7f59b272dd6a1da` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:24.725226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829eb4dc-e42e-44f0-9930-a185bd32583d None admin] RBAC: Authorizing `identity:get_project(project_id=30da536aaf80437da7f59b272dd6a1da)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:24.726698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829eb4dc-e42e-44f0-9930-a185bd32583d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:24.733925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 526/1052] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:52:24 2022] GET /identity/v3/projects/30da536aaf80437da7f59b272dd6a1da => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:24.737410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b985493-182c-4d06-9d69-2a9e85282792 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:24.837299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b985493-182c-4d06-9d69-2a9e85282792 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:24.872173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001ae2d-aeee-40a5-a055-c27530b5bebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:24.872873 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001ae2d-aeee-40a5-a055-c27530b5bebb None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:24.873161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001ae2d-aeee-40a5-a055-c27530b5bebb None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:24.873440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001ae2d-aeee-40a5-a055-c27530b5bebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:24.874202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001ae2d-aeee-40a5-a055-c27530b5bebb None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=30da536aaf80437da7f59b272dd6a1da, user.id=b76928fb507d4752974f5959011c3f69) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:24.874517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001ae2d-aeee-40a5-a055-c27530b5bebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:24.875961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001ae2d-aeee-40a5-a055-c27530b5bebb None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:24.888498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 527/1053] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:52:24 2022] GET /identity/v3/role_assignments?user.id=b76928fb507d4752974f5959011c3f69&scope.project.id=30da536aaf80437da7f59b272dd6a1da&role.id=56228137a4444ef9b7e688d04abd00fd => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:24.925307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603cec6-43e9-42d4-a55e-452e955b2c7f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:24.925884 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603cec6-43e9-42d4-a55e-452e955b2c7f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:24.925884 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603cec6-43e9-42d4-a55e-452e955b2c7f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:24.927434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 527/1054] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:24.933194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97670ecf-379c-40bd-b5cb-f6a41d9b4c2b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:24.933733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97670ecf-379c-40bd-b5cb-f6a41d9b4c2b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:24.933733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97670ecf-379c-40bd-b5cb-f6a41d9b4c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:24.953280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-97670ecf-379c-40bd-b5cb-f6a41d9b4c2b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:24.954514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-97670ecf-379c-40bd-b5cb-f6a41d9b4c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:24.979460 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:25.035556 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 528/1055] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:25.299796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603cec6-43e9-42d4-a55e-452e955b2c7f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:25.407253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603cec6-43e9-42d4-a55e-452e955b2c7f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:25.425203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:25.444337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca082d7-70fb-4637-b9ae-b2112c4d8bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:25.445001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca082d7-70fb-4637-b9ae-b2112c4d8bcc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:25.445283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca082d7-70fb-4637-b9ae-b2112c4d8bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:25.445556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca082d7-70fb-4637-b9ae-b2112c4d8bcc None admin] PATH_INFO: `/v3/services/image` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:25.446134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca082d7-70fb-4637-b9ae-b2112c4d8bcc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:25.447501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca082d7-70fb-4637-b9ae-b2112c4d8bcc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-eca082d7-70fb-4637-b9ae-b2112c4d8bcc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:25.456917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:25.457974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 16:52:25.458848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:25.460793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 528/1056] 10.222.0.81 () {56 vars in 1105 bytes} [Thu Aug 18 16:52:25 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:25.463901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97670ecf-379c-40bd-b5cb-f6a41d9b4c2b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:25.518541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8beb2-5c25-4463-afd0-a85ef75dda6f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:25.518866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8beb2-5c25-4463-afd0-a85ef75dda6f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:25.519104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8beb2-5c25-4463-afd0-a85ef75dda6f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:25.520474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 529/1057] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:25.525575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cdd0-e68a-4890-bdcc-3201de2cd00c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:25.525863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cdd0-e68a-4890-bdcc-3201de2cd00c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:25.526144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cdd0-e68a-4890-bdcc-3201de2cd00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:25.549085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-94e7cdd0-e68a-4890-bdcc-3201de2cd00c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:25.550354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-94e7cdd0-e68a-4890-bdcc-3201de2cd00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:25.582836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97670ecf-379c-40bd-b5cb-f6a41d9b4c2b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:25.619783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 530/1058] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:25.620135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ea030-70c2-48b8-9e2f-78bc03954872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:25.620790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ea030-70c2-48b8-9e2f-78bc03954872 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:25.621069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ea030-70c2-48b8-9e2f-78bc03954872 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:25.621346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ea030-70c2-48b8-9e2f-78bc03954872 None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:25.621982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ea030-70c2-48b8-9e2f-78bc03954872 None admin] RBAC: Adding query filter params (name=image) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:25.622291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ea030-70c2-48b8-9e2f-78bc03954872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:25.623656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ea030-70c2-48b8-9e2f-78bc03954872 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:25.633298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 529/1059] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:25.634397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7cdd0-e68a-4890-bdcc-3201de2cd00c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:25.746114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7cdd0-e68a-4890-bdcc-3201de2cd00c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:25.769010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:25.795580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd67eb-5064-4ebe-a74c-f7904dc76f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:25.796204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd67eb-5064-4ebe-a74c-f7904dc76f93 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:25.796505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd67eb-5064-4ebe-a74c-f7904dc76f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:25.796786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd67eb-5064-4ebe-a74c-f7904dc76f93 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:25.797419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd67eb-5064-4ebe-a74c-f7904dc76f93 None admin] RBAC: Adding query filter params (type=image) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:25.797728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd67eb-5064-4ebe-a74c-f7904dc76f93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:25.799087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd67eb-5064-4ebe-a74c-f7904dc76f93 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:25.808719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 531/1060] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:25.809830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ea030-70c2-48b8-9e2f-78bc03954872 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:25.834407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:25.895957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd67eb-5064-4ebe-a74c-f7904dc76f93 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:25.918726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ea030-70c2-48b8-9e2f-78bc03954872 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:25.961832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471796c4-f5ad-459c-a268-253444d82445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:25.962494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471796c4-f5ad-459c-a268-253444d82445 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:25.962715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471796c4-f5ad-459c-a268-253444d82445 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:25.962995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471796c4-f5ad-459c-a268-253444d82445 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:25.963674 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471796c4-f5ad-459c-a268-253444d82445 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:25.965386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471796c4-f5ad-459c-a268-253444d82445 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:25.987597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 530/1061] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 16:52:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:26.008174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd67eb-5064-4ebe-a74c-f7904dc76f93 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:26.054354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622e73a-d1c8-4acb-a110-dbe95fc83eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:26.055013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622e73a-d1c8-4acb-a110-dbe95fc83eef None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:26.055904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622e73a-d1c8-4acb-a110-dbe95fc83eef None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:26.055904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622e73a-d1c8-4acb-a110-dbe95fc83eef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:26.069328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622e73a-d1c8-4acb-a110-dbe95fc83eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-6622e73a-d1c8-4acb-a110-dbe95fc83eef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:26.074090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:26.075108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:26.076053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:26.081100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 532/1062] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Aug 18 16:52:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:26.082150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471796c4-f5ad-459c-a268-253444d82445 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:26.166161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:26.191946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471796c4-f5ad-459c-a268-253444d82445 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:26.226142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81185270-b58d-4d76-b302-0a481cdbcace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:26.226757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185270-b58d-4d76-b302-0a481cdbcace None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:26.227037 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185270-b58d-4d76-b302-0a481cdbcace None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:26.227307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81185270-b58d-4d76-b302-0a481cdbcace None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:26.227975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81185270-b58d-4d76-b302-0a481cdbcace None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:26.228278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81185270-b58d-4d76-b302-0a481cdbcace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:26.229682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81185270-b58d-4d76-b302-0a481cdbcace None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:26.243539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 531/1063] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Aug 18 16:52:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:26.245229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622e73a-d1c8-4acb-a110-dbe95fc83eef None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:26.277678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:26.350664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622e73a-d1c8-4acb-a110-dbe95fc83eef None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:26.384910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38138785-585b-4424-9933-348bbda992bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:26.385551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38138785-585b-4424-9933-348bbda992bd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:26.385833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38138785-585b-4424-9933-348bbda992bd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:26.386108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38138785-585b-4424-9933-348bbda992bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:26.397429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38138785-585b-4424-9933-348bbda992bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:26.398880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38138785-585b-4424-9933-348bbda992bd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-38138785-585b-4424-9933-348bbda992bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:26.413270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:26.414316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:26.415340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:26.415340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:26.415340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:26.416700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 533/1064] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:26.421161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81185270-b58d-4d76-b302-0a481cdbcace None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:26.529722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81185270-b58d-4d76-b302-0a481cdbcace None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:26.564739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e2070-e13f-4d46-8de9-2511736594a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:26.565399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e2070-e13f-4d46-8de9-2511736594a2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:26.565685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e2070-e13f-4d46-8de9-2511736594a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:26.565964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e2070-e13f-4d46-8de9-2511736594a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:26.566610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e2070-e13f-4d46-8de9-2511736594a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:26.566910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e2070-e13f-4d46-8de9-2511736594a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:26.568275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e2070-e13f-4d46-8de9-2511736594a2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:26.575576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:26.586241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 532/1065] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:26.587917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38138785-585b-4424-9933-348bbda992bd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:26.671658 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:26.692922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38138785-585b-4424-9933-348bbda992bd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:26.731133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327cce0-b08d-40ca-b2b9-c649ecb87efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:26.731783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327cce0-b08d-40ca-b2b9-c649ecb87efc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:26.732068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327cce0-b08d-40ca-b2b9-c649ecb87efc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:26.732345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327cce0-b08d-40ca-b2b9-c649ecb87efc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:26.745546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327cce0-b08d-40ca-b2b9-c649ecb87efc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:26.746991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327cce0-b08d-40ca-b2b9-c649ecb87efc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-7327cce0-b08d-40ca-b2b9-c649ecb87efc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:52:26.759208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:26.760241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:26.761605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:26.761605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:26.761605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:52:26.761605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:52:26.761605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:52:26.761605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:52:26.761605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:52:26.761605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:52:26.761605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:52:26.761605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:26.764538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 534/1066] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Aug 18 16:52:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:26.766387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e2070-e13f-4d46-8de9-2511736594a2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:26.779185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c95ab-1f53-4384-a918-d5e3cf119ae9 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:26.779466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c95ab-1f53-4384-a918-d5e3cf119ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:26.779739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c95ab-1f53-4384-a918-d5e3cf119ae9 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:26.781769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 535/1067] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:52:26.786385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d303f2-4851-4f75-82ee-792a7ccb29f7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:26.786712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d303f2-4851-4f75-82ee-792a7ccb29f7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:26.786946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d303f2-4851-4f75-82ee-792a7ccb29f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:26.808291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b2d303f2-4851-4f75-82ee-792a7ccb29f7 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:26.810001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b2d303f2-4851-4f75-82ee-792a7ccb29f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:26.873273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e2070-e13f-4d46-8de9-2511736594a2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:26.894593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 536/1068] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:26.912423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6b9a3-7774-4623-8cd8-669071adc649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:26.913065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b9a3-7774-4623-8cd8-669071adc649 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:26.913350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b9a3-7774-4623-8cd8-669071adc649 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:26.913628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6b9a3-7774-4623-8cd8-669071adc649 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:26.914364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b9a3-7774-4623-8cd8-669071adc649 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:26.914675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b9a3-7774-4623-8cd8-669071adc649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:26.916098 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6b9a3-7774-4623-8cd8-669071adc649 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:26.938975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 533/1069] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Aug 18 16:52:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:26.940144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d303f2-4851-4f75-82ee-792a7ccb29f7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:27.014921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:27.048779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d303f2-4851-4f75-82ee-792a7ccb29f7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:27.086313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c275cb9-f28e-4b51-a913-eb1337f38936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:27.086953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275cb9-f28e-4b51-a913-eb1337f38936 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.087238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275cb9-f28e-4b51-a913-eb1337f38936 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.087511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275cb9-f28e-4b51-a913-eb1337f38936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.098401 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c275cb9-f28e-4b51-a913-eb1337f38936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:27.099895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c275cb9-f28e-4b51-a913-eb1337f38936 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-6c275cb9-f28e-4b51-a913-eb1337f38936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:27.116841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:27.118037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:27.124421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:27.124421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:27.124421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:27.124421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 537/1070] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:27.124714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6b9a3-7774-4623-8cd8-669071adc649 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:27.159772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c275cb9-f28e-4b51-a913-eb1337f38936 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:27.187889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:27.239924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6b9a3-7774-4623-8cd8-669071adc649 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:27.272271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c275cb9-f28e-4b51-a913-eb1337f38936 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:27.276028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df67c0a-c91b-4d3f-8119-8805e4579023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:27.276668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df67c0a-c91b-4d3f-8119-8805e4579023 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.277005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df67c0a-c91b-4d3f-8119-8805e4579023 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.277285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df67c0a-c91b-4d3f-8119-8805e4579023 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.277927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df67c0a-c91b-4d3f-8119-8805e4579023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:27.278232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df67c0a-c91b-4d3f-8119-8805e4579023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:27.280102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df67c0a-c91b-4d3f-8119-8805e4579023 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:27.291388 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 534/1071] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:27.297441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df67c0a-c91b-4d3f-8119-8805e4579023 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:27.299708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:27.314010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e24601-a423-436d-ae4e-781cad095f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:27.314648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e24601-a423-436d-ae4e-781cad095f90 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.314927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e24601-a423-436d-ae4e-781cad095f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.315195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e24601-a423-436d-ae4e-781cad095f90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.326023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e24601-a423-436d-ae4e-781cad095f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-a9e24601-a423-436d-ae4e-781cad095f90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:27.330674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:27.331625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:27.333318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 538/1072] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:52:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:27.337598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e24601-a423-436d-ae4e-781cad095f90 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:27.408392 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df67c0a-c91b-4d3f-8119-8805e4579023 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:27.429869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:27.445383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e24601-a423-436d-ae4e-781cad095f90 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:27.449871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901680a-755e-4d5b-a049-4d9a3b75bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:27.450509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901680a-755e-4d5b-a049-4d9a3b75bf8e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.450789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901680a-755e-4d5b-a049-4d9a3b75bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.451062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901680a-755e-4d5b-a049-4d9a3b75bf8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.458660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901680a-755e-4d5b-a049-4d9a3b75bf8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:27.460251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901680a-755e-4d5b-a049-4d9a3b75bf8e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a901680a-755e-4d5b-a049-4d9a3b75bf8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:52:27.472981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:27.474088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:27.475105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:52:27.475105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:52:27.475105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:52:27.475105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:52:27.475105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:52:27.475105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:52:27.475105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:27.475105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:27.475105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 535/1073] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:27.480111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901680a-755e-4d5b-a049-4d9a3b75bf8e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:27.486777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb803de-30bf-4194-8d20-36c57e6256da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:27.487404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb803de-30bf-4194-8d20-36c57e6256da None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.487692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb803de-30bf-4194-8d20-36c57e6256da None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.488217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb803de-30bf-4194-8d20-36c57e6256da None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.488932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb803de-30bf-4194-8d20-36c57e6256da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:27.489265 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb803de-30bf-4194-8d20-36c57e6256da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:27.490699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb803de-30bf-4194-8d20-36c57e6256da None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:27.504520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 539/1074] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:52:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:27.507295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb803de-30bf-4194-8d20-36c57e6256da None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:27.567639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:27.599064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901680a-755e-4d5b-a049-4d9a3b75bf8e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:27.626450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb803de-30bf-4194-8d20-36c57e6256da None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:27.636370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcb02c-2eaa-47d1-bdc9-5197575d92ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:27.637017 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb02c-2eaa-47d1-bdc9-5197575d92ac None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.637574 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb02c-2eaa-47d1-bdc9-5197575d92ac None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.637874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcb02c-2eaa-47d1-bdc9-5197575d92ac None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.638575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcb02c-2eaa-47d1-bdc9-5197575d92ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:27.638885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcb02c-2eaa-47d1-bdc9-5197575d92ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:27.640895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcb02c-2eaa-47d1-bdc9-5197575d92ac None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:27.653413 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 536/1075] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:27.659053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcb02c-2eaa-47d1-bdc9-5197575d92ac None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:27.662761 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1b6ec-7298-4088-b745-ef4f99a312ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:27.663497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1b6ec-7298-4088-b745-ef4f99a312ab None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.663788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1b6ec-7298-4088-b745-ef4f99a312ab None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.664064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1b6ec-7298-4088-b745-ef4f99a312ab None admin] PATH_INFO: `/v3/users/b76928fb507d4752974f5959011c3f69` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.665232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1b6ec-7298-4088-b745-ef4f99a312ab None admin] RBAC: Authorizing `identity:get_user(user_id=b76928fb507d4752974f5959011c3f69)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:27.666670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1b6ec-7298-4088-b745-ef4f99a312ab None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:27.668407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 540/1076] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:27 2022] GET /identity/v3/users/b76928fb507d4752974f5959011c3f69 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:27.673959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1b6ec-7298-4088-b745-ef4f99a312ab None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:27.700853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:27.772030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcb02c-2eaa-47d1-bdc9-5197575d92ac None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:27.797204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1b6ec-7298-4088-b745-ef4f99a312ab None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:27.810929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:27.812737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021550c-7797-49eb-a80a-6cdcde153758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:27.814284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021550c-7797-49eb-a80a-6cdcde153758 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.814954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021550c-7797-49eb-a80a-6cdcde153758 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.815429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021550c-7797-49eb-a80a-6cdcde153758 None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/c425b390c8dc4d799270fdd095be78b4/roles/b8bacb93751c4fcdb352c4557a49cbc7` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.817969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021550c-7797-49eb-a80a-6cdcde153758 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=c425b390c8dc4d799270fdd095be78b4, role_id=b8bacb93751c4fcdb352c4557a49cbc7)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:27.819619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021550c-7797-49eb-a80a-6cdcde153758 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:27.832980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44471916-11c3-4c09-b460-77bb6a0dd90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:27.833620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471916-11c3-4c09-b460-77bb6a0dd90f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.833903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471916-11c3-4c09-b460-77bb6a0dd90f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.834181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471916-11c3-4c09-b460-77bb6a0dd90f None admin] PATH_INFO: `/v3/projects/30da536aaf80437da7f59b272dd6a1da` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.835167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 537/1077] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:52:27 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/c425b390c8dc4d799270fdd095be78b4/roles/b8bacb93751c4fcdb352c4557a49cbc7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:52:27.844059 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44471916-11c3-4c09-b460-77bb6a0dd90f None admin] RBAC: Authorizing `identity:get_project(project_id=30da536aaf80437da7f59b272dd6a1da)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:27.844059 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44471916-11c3-4c09-b460-77bb6a0dd90f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:27.844059 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 541/1078] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:52:27 2022] GET /identity/v3/projects/30da536aaf80437da7f59b272dd6a1da => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:27.845361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44471916-11c3-4c09-b460-77bb6a0dd90f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:27.936904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f724-1f39-4723-a389-64ff60217073 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.937215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f724-1f39-4723-a389-64ff60217073 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.937498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50f724-1f39-4723-a389-64ff60217073 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.938862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 538/1079] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:52:27.944525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaad36-0f79-498f-8ac0-3ebe57a80c2d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:27.944819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaad36-0f79-498f-8ac0-3ebe57a80c2d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:27.945102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaad36-0f79-498f-8ac0-3ebe57a80c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:27.963235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44471916-11c3-4c09-b460-77bb6a0dd90f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:27.965782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9cbaad36-0f79-498f-8ac0-3ebe57a80c2d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:27.969027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9cbaad36-0f79-498f-8ac0-3ebe57a80c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:28.007400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87b054-260e-41bd-b5ed-adc862393c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:28.008104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87b054-260e-41bd-b5ed-adc862393c7d None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:28.008385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87b054-260e-41bd-b5ed-adc862393c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:28.008692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87b054-260e-41bd-b5ed-adc862393c7d None admin] PATH_INFO: `/v3/projects/30da536aaf80437da7f59b272dd6a1da/users/b76928fb507d4752974f5959011c3f69/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:28.010698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87b054-260e-41bd-b5ed-adc862393c7d None admin] RBAC: Authorizing `identity:create_grant(project_id=30da536aaf80437da7f59b272dd6a1da, user_id=b76928fb507d4752974f5959011c3f69, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:28.012135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87b054-260e-41bd-b5ed-adc862393c7d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:28.027592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 542/1080] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:52:27 2022] PUT /identity/v3/projects/30da536aaf80437da7f59b272dd6a1da/users/b76928fb507d4752974f5959011c3f69/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:52:28.053283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 539/1081] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:28.321776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87b054-260e-41bd-b5ed-adc862393c7d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:28.368758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:28.430211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87b054-260e-41bd-b5ed-adc862393c7d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:28.465738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206af765-8d22-4e90-8ca1-aae9792c5bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:28.468558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206af765-8d22-4e90-8ca1-aae9792c5bba None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:28.468558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206af765-8d22-4e90-8ca1-aae9792c5bba None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:28.468558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206af765-8d22-4e90-8ca1-aae9792c5bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:28.537455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206af765-8d22-4e90-8ca1-aae9792c5bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:28.538907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206af765-8d22-4e90-8ca1-aae9792c5bba None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:28.583783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:28.644548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 543/1082] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:52:28.650247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbaad36-0f79-498f-8ac0-3ebe57a80c2d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:28.678137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:28.763904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbaad36-0f79-498f-8ac0-3ebe57a80c2d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:28.798664 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbbdbe-51bb-415e-ad48-aeeba0ef95f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:28.799341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbbdbe-51bb-415e-ad48-aeeba0ef95f8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:28.799596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbbdbe-51bb-415e-ad48-aeeba0ef95f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:28.799875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbbdbe-51bb-415e-ad48-aeeba0ef95f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:28.815516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbbdbe-51bb-415e-ad48-aeeba0ef95f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:28.817039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbbdbe-51bb-415e-ad48-aeeba0ef95f8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-efbbbdbe-51bb-415e-ad48-aeeba0ef95f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:28.835448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:28.836418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:28.837361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:28.837361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:28.837361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:28.837361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 540/1083] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:28.843028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206af765-8d22-4e90-8ca1-aae9792c5bba None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:28.947799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206af765-8d22-4e90-8ca1-aae9792c5bba None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:28.984759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05013741-ca71-4335-8dd1-4eed86c71c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:28.985442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013741-ca71-4335-8dd1-4eed86c71c4d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:28.985732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013741-ca71-4335-8dd1-4eed86c71c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:28.986012 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013741-ca71-4335-8dd1-4eed86c71c4d None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:28.986661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05013741-ca71-4335-8dd1-4eed86c71c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:28.986969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05013741-ca71-4335-8dd1-4eed86c71c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:28.988619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05013741-ca71-4335-8dd1-4eed86c71c4d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:29.008492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 544/1084] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:29.749438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1454c73-fec2-4f04-8927-8bec2a28d62a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:29.749903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1454c73-fec2-4f04-8927-8bec2a28d62a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:29.749994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1454c73-fec2-4f04-8927-8bec2a28d62a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:29.751331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 541/1085] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:29.756485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936beaa-3e11-4dc8-9848-38a2b420a58f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:29.756923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936beaa-3e11-4dc8-9848-38a2b420a58f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:29.757057 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936beaa-3e11-4dc8-9848-38a2b420a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:29.763265 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:29.776194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2936beaa-3e11-4dc8-9848-38a2b420a58f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:29.777412 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2936beaa-3e11-4dc8-9848-38a2b420a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:29.843501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 545/1086] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:29.922999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b455-ae74-4365-9308-d33156a33bbd None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:29.923272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b455-ae74-4365-9308-d33156a33bbd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:29.923546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439b455-ae74-4365-9308-d33156a33bbd None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:29.924984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 542/1087] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:29.930103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8eabe-27d7-483a-9c1d-a8c944f22d5e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:29.930395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8eabe-27d7-483a-9c1d-a8c944f22d5e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:29.930672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8eabe-27d7-483a-9c1d-a8c944f22d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:29.949063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7ec8eabe-27d7-483a-9c1d-a8c944f22d5e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:29.950231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7ec8eabe-27d7-483a-9c1d-a8c944f22d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:30.018213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 546/1088] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:30.117298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439b455-ae74-4365-9308-d33156a33bbd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:30.198563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:30.221278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439b455-ae74-4365-9308-d33156a33bbd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:30.255202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b416d7b-27f0-4d87-9d96-fc3da0b23435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:30.255831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b416d7b-27f0-4d87-9d96-fc3da0b23435 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:30.256112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b416d7b-27f0-4d87-9d96-fc3da0b23435 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:30.256385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b416d7b-27f0-4d87-9d96-fc3da0b23435 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:30.266296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b416d7b-27f0-4d87-9d96-fc3da0b23435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6b416d7b-27f0-4d87-9d96-fc3da0b23435 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:30.271035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:30.272238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 16:52:30.273302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:30.274474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 543/1089] 10.222.0.81 () {56 vars in 1120 bytes} [Thu Aug 18 16:52:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:30.277990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8eabe-27d7-483a-9c1d-a8c944f22d5e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:30.285433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b416d7b-27f0-4d87-9d96-fc3da0b23435 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:30.340862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:30.380425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8eabe-27d7-483a-9c1d-a8c944f22d5e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:30.384408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b416d7b-27f0-4d87-9d96-fc3da0b23435 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:30.414903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9c5ba-000d-4762-b849-050548f918b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:30.415514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9c5ba-000d-4762-b849-050548f918b6 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:30.415790 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9c5ba-000d-4762-b849-050548f918b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:30.416061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9c5ba-000d-4762-b849-050548f918b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:30.416748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9c5ba-000d-4762-b849-050548f918b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:30.417048 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9c5ba-000d-4762-b849-050548f918b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:30.418404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9c5ba-000d-4762-b849-050548f918b6 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:30.418693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97307a9-cf2c-47df-84cb-5d0abd2580a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:30.419330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97307a9-cf2c-47df-84cb-5d0abd2580a2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:30.419652 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97307a9-cf2c-47df-84cb-5d0abd2580a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:30.419933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97307a9-cf2c-47df-84cb-5d0abd2580a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:30.426275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 547/1090] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Aug 18 16:52:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:30.427058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:30.432144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9c5ba-000d-4762-b849-050548f918b6 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:30.432289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97307a9-cf2c-47df-84cb-5d0abd2580a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d97307a9-cf2c-47df-84cb-5d0abd2580a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:30.437272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:30.438634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:30.439812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:30.443430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 544/1091] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:30.444271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97307a9-cf2c-47df-84cb-5d0abd2580a2 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:30.534399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9c5ba-000d-4762-b849-050548f918b6 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:30.545300 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97307a9-cf2c-47df-84cb-5d0abd2580a2 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:30.556821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:30.568485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c4ba1-f9ed-407b-95df-41b86025ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:30.569130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4ba1-f9ed-407b-95df-41b86025ea9b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:30.569419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4ba1-f9ed-407b-95df-41b86025ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:30.569707 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4ba1-f9ed-407b-95df-41b86025ea9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:30.580396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c4ba1-f9ed-407b-95df-41b86025ea9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:30.580673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ad33-4437-4248-a58e-c3f257aa043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:30.581356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ad33-4437-4248-a58e-c3f257aa043e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:30.581639 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ad33-4437-4248-a58e-c3f257aa043e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:30.581865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c4ba1-f9ed-407b-95df-41b86025ea9b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:30.581977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ad33-4437-4248-a58e-c3f257aa043e None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:30.582570 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87ad33-4437-4248-a58e-c3f257aa043e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:30.582875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87ad33-4437-4248-a58e-c3f257aa043e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:30.584227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87ad33-4437-4248-a58e-c3f257aa043e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:30.592785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 545/1092] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-5d5c4ba1-f9ed-407b-95df-41b86025ea9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:30.596347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:30.597538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:30.598974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:30.598974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:30.598974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:30.598974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 548/1093] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:30.599262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ad33-4437-4248-a58e-c3f257aa043e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:30.603071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c4ba1-f9ed-407b-95df-41b86025ea9b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:30.656186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:30.697672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ad33-4437-4248-a58e-c3f257aa043e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:30.700912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c4ba1-f9ed-407b-95df-41b86025ea9b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:30.731765 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd6324-f13b-4b2c-a636-7171ac6203ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:30.732404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd6324-f13b-4b2c-a636-7171ac6203ff None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:30.732710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd6324-f13b-4b2c-a636-7171ac6203ff None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:30.733019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd6324-f13b-4b2c-a636-7171ac6203ff None admin] PATH_INFO: `/v3/users/b76928fb507d4752974f5959011c3f69` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:30.734018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c33f8-de35-4aa2-a266-edacb7742541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:30.734145 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd6324-f13b-4b2c-a636-7171ac6203ff None admin] RBAC: Authorizing `identity:get_user(user_id=b76928fb507d4752974f5959011c3f69)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:30.734644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c33f8-de35-4aa2-a266-edacb7742541 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:30.734987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c33f8-de35-4aa2-a266-edacb7742541 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:30.735323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c33f8-de35-4aa2-a266-edacb7742541 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:30.735528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd6324-f13b-4b2c-a636-7171ac6203ff None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:30.735976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c33f8-de35-4aa2-a266-edacb7742541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:30.736288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c33f8-de35-4aa2-a266-edacb7742541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:30.737312 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 546/1094] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:30 2022] GET /identity/v3/users/b76928fb507d4752974f5959011c3f69 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:30.737763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c33f8-de35-4aa2-a266-edacb7742541 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:30.743226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd6324-f13b-4b2c-a636-7171ac6203ff None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:30.755760 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 549/1095] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:30.756768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c33f8-de35-4aa2-a266-edacb7742541 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:30.791041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:30.845651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd6324-f13b-4b2c-a636-7171ac6203ff None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:30.864745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c33f8-de35-4aa2-a266-edacb7742541 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:30.874341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:30.883204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d072b8-f79d-4690-b8ec-e4af1921eff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:30.883812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d072b8-f79d-4690-b8ec-e4af1921eff3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:30.884096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d072b8-f79d-4690-b8ec-e4af1921eff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:30.884367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d072b8-f79d-4690-b8ec-e4af1921eff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:30.910515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f6039-f9c6-4f7d-ae40-025cf4ee1950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:30.911162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f6039-f9c6-4f7d-ae40-025cf4ee1950 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:30.911449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f6039-f9c6-4f7d-ae40-025cf4ee1950 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:30.911729 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f6039-f9c6-4f7d-ae40-025cf4ee1950 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:30.919818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f6039-f9c6-4f7d-ae40-025cf4ee1950 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:30.921837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f6039-f9c6-4f7d-ae40-025cf4ee1950 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-db6f6039-f9c6-4f7d-ae40-025cf4ee1950 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:52:30.935625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:30.938026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:30.939885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 550/1096] 10.222.0.81 () {56 vars in 1093 bytes} [Thu Aug 18 16:52:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:30.943360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f6039-f9c6-4f7d-ae40-025cf4ee1950 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:30.968685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d072b8-f79d-4690-b8ec-e4af1921eff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:30.970214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d072b8-f79d-4690-b8ec-e4af1921eff3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:31.057092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:31.064154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f6039-f9c6-4f7d-ae40-025cf4ee1950 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:31.078166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 547/1097] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:52:31.083692 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d072b8-f79d-4690-b8ec-e4af1921eff3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:31.097596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a89c8-8ce5-4dc9-9d83-f7215b8f5b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:31.098221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a89c8-8ce5-4dc9-9d83-f7215b8f5b02 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:31.098491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a89c8-8ce5-4dc9-9d83-f7215b8f5b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:31.098765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a89c8-8ce5-4dc9-9d83-f7215b8f5b02 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:31.099484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a89c8-8ce5-4dc9-9d83-f7215b8f5b02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:31.099792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a89c8-8ce5-4dc9-9d83-f7215b8f5b02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:31.101244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a89c8-8ce5-4dc9-9d83-f7215b8f5b02 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:31.110941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:31.120491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 551/1098] 10.222.0.81 () {56 vars in 1133 bytes} [Thu Aug 18 16:52:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:31.125745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a89c8-8ce5-4dc9-9d83-f7215b8f5b02 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:31.183099 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d072b8-f79d-4690-b8ec-e4af1921eff3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:31.218078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f276c-4a23-48e6-804e-42f333607349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:31.218762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f276c-4a23-48e6-804e-42f333607349 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:31.219050 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f276c-4a23-48e6-804e-42f333607349 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:31.219331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f276c-4a23-48e6-804e-42f333607349 None admin] PATH_INFO: `/v3/projects/30da536aaf80437da7f59b272dd6a1da` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:31.220444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f276c-4a23-48e6-804e-42f333607349 None admin] RBAC: Authorizing `identity:get_project(project_id=30da536aaf80437da7f59b272dd6a1da)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:31.221905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f276c-4a23-48e6-804e-42f333607349 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:31.222193 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a89c8-8ce5-4dc9-9d83-f7215b8f5b02 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:31.223547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 548/1099] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:52:31 2022] GET /identity/v3/projects/30da536aaf80437da7f59b272dd6a1da => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:31.229723 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f276c-4a23-48e6-804e-42f333607349 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:31.256730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a97d8-4351-4fd2-82e2-283294b8b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:31.257360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a97d8-4351-4fd2-82e2-283294b8b678 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:31.257627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a97d8-4351-4fd2-82e2-283294b8b678 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:31.257902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a97d8-4351-4fd2-82e2-283294b8b678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:31.282151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:31.323260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:31.327937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a97d8-4351-4fd2-82e2-283294b8b678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:31.329448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a97d8-4351-4fd2-82e2-283294b8b678 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:31.330250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f276c-4a23-48e6-804e-42f333607349 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:31.365270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0819-745f-4433-836d-70a2c62d156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:31.365880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0819-745f-4433-836d-70a2c62d156b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:31.366177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0819-745f-4433-836d-70a2c62d156b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:31.366445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d0819-745f-4433-836d-70a2c62d156b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:31.367176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d0819-745f-4433-836d-70a2c62d156b None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=30da536aaf80437da7f59b272dd6a1da, user.id=b76928fb507d4752974f5959011c3f69) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:31.367500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d0819-745f-4433-836d-70a2c62d156b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:31.368957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d0819-745f-4433-836d-70a2c62d156b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:31.375373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 549/1100] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:52:31 2022] GET /identity/v3/role_assignments?user.id=b76928fb507d4752974f5959011c3f69&scope.project.id=30da536aaf80437da7f59b272dd6a1da&role.id=56228137a4444ef9b7e688d04abd00fd => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:31.435664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 552/1101] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:52:31.442241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0819-745f-4433-836d-70a2c62d156b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:31.548980 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d0819-745f-4433-836d-70a2c62d156b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:31.583628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df587aaf-5d36-4618-9c27-08e999436c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:31.584185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587aaf-5d36-4618-9c27-08e999436c1c None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:31.584495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587aaf-5d36-4618-9c27-08e999436c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:31.584768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df587aaf-5d36-4618-9c27-08e999436c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:31.595174 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df587aaf-5d36-4618-9c27-08e999436c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:31.596665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df587aaf-5d36-4618-9c27-08e999436c1c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-df587aaf-5d36-4618-9c27-08e999436c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:52:31.611130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:31.612152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:52:31.613402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:52:31.613402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:52:31.613402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:31.613402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 550/1102] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:31.618263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a97d8-4351-4fd2-82e2-283294b8b678 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:31.672959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:31.716814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a97d8-4351-4fd2-82e2-283294b8b678 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:31.754887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e46505-d987-4d80-a422-dda3754ac15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:31.755504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46505-d987-4d80-a422-dda3754ac15c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:31.755816 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46505-d987-4d80-a422-dda3754ac15c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:31.756089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46505-d987-4d80-a422-dda3754ac15c None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:31.756760 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e46505-d987-4d80-a422-dda3754ac15c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:31.757066 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e46505-d987-4d80-a422-dda3754ac15c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:31.758429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e46505-d987-4d80-a422-dda3754ac15c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:31.769885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 553/1103] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:31.775465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df587aaf-5d36-4618-9c27-08e999436c1c None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:31.792826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:31.875101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df587aaf-5d36-4618-9c27-08e999436c1c None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:31.908587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865c9cc-364f-44a2-8512-30fd139a0063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:31.909215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865c9cc-364f-44a2-8512-30fd139a0063 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:31.909494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865c9cc-364f-44a2-8512-30fd139a0063 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:31.909766 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865c9cc-364f-44a2-8512-30fd139a0063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:31.916183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865c9cc-364f-44a2-8512-30fd139a0063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:31.917634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865c9cc-364f-44a2-8512-30fd139a0063 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5865c9cc-364f-44a2-8512-30fd139a0063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:52:31.928984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:31.930006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:31.930938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:52:31.930938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:52:31.930938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:52:31.930938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:52:31.930938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:52:31.930938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:52:31.930938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:52:31.930938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:31.930938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 551/1104] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:52:31.935940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e46505-d987-4d80-a422-dda3754ac15c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:32.037924 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e46505-d987-4d80-a422-dda3754ac15c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:32.053888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:32.075303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27652cb7-95bd-41c7-bc12-df596bb99c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:32.075918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27652cb7-95bd-41c7-bc12-df596bb99c1f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:32.076195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27652cb7-95bd-41c7-bc12-df596bb99c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:32.076483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27652cb7-95bd-41c7-bc12-df596bb99c1f None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:32.077783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27652cb7-95bd-41c7-bc12-df596bb99c1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:32.078091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27652cb7-95bd-41c7-bc12-df596bb99c1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:32.079523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27652cb7-95bd-41c7-bc12-df596bb99c1f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:32.092153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 554/1105] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:32.098258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865c9cc-364f-44a2-8512-30fd139a0063 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:32.166347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:32.196183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865c9cc-364f-44a2-8512-30fd139a0063 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:32.229688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8af23-084a-4396-ab43-7f7f14bc01a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:32.230292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8af23-084a-4396-ab43-7f7f14bc01a9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:32.230567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8af23-084a-4396-ab43-7f7f14bc01a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:32.230839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8af23-084a-4396-ab43-7f7f14bc01a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:32.231561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8af23-084a-4396-ab43-7f7f14bc01a9 None admin] RBAC: Adding query filter params (role.id=b8bacb93751c4fcdb352c4557a49cbc7, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=c425b390c8dc4d799270fdd095be78b4) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:32.231864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8af23-084a-4396-ab43-7f7f14bc01a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:32.233356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8af23-084a-4396-ab43-7f7f14bc01a9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:32.239339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 552/1106] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:52:32 2022] GET /identity/v3/role_assignments?user.id=c425b390c8dc4d799270fdd095be78b4&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b8bacb93751c4fcdb352c4557a49cbc7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:33.309985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ce4c-0629-4053-9a51-352c163e8948 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:33.310530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ce4c-0629-4053-9a51-352c163e8948 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:33.310530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ce4c-0629-4053-9a51-352c163e8948 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:33.311875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 555/1107] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:33.317243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13933dc8-a3d4-4591-943d-e60036a8e8c0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:33.317628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13933dc8-a3d4-4591-943d-e60036a8e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:33.317808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13933dc8-a3d4-4591-943d-e60036a8e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:33.335884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-13933dc8-a3d4-4591-943d-e60036a8e8c0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:33.337109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-13933dc8-a3d4-4591-943d-e60036a8e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:33.403055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 553/1108] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:33.672686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ce4c-0629-4053-9a51-352c163e8948 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:33.772998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ce4c-0629-4053-9a51-352c163e8948 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:33.805320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf62ba-54ff-4308-b721-77e2712905e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:33.805939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf62ba-54ff-4308-b721-77e2712905e9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:33.806219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf62ba-54ff-4308-b721-77e2712905e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:33.806494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf62ba-54ff-4308-b721-77e2712905e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:33.807589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf62ba-54ff-4308-b721-77e2712905e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:33.809039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf62ba-54ff-4308-b721-77e2712905e9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:33.810594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 556/1109] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:33.817058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13933dc8-a3d4-4591-943d-e60036a8e8c0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:33.879133 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:33.912449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13933dc8-a3d4-4591-943d-e60036a8e8c0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:33.945527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708976e7-9bc8-406d-b70d-340592dca0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:33.946071 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708976e7-9bc8-406d-b70d-340592dca0aa None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:33.946353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708976e7-9bc8-406d-b70d-340592dca0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:33.946629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708976e7-9bc8-406d-b70d-340592dca0aa None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:33.947263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708976e7-9bc8-406d-b70d-340592dca0aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:33.948709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708976e7-9bc8-406d-b70d-340592dca0aa None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:33.969565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 554/1110] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:52:33 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:35.902888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b410-8815-4769-b569-cbee44a50ca6 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:35.903467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b410-8815-4769-b569-cbee44a50ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:35.903467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b410-8815-4769-b569-cbee44a50ca6 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:35.905339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 557/1111] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:35.910531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a0a4-78f0-4241-b9b3-10952fb23408 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:35.910957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a0a4-78f0-4241-b9b3-10952fb23408 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:35.911088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a0a4-78f0-4241-b9b3-10952fb23408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:35.929228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9e60a0a4-78f0-4241-b9b3-10952fb23408 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:35.930394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9e60a0a4-78f0-4241-b9b3-10952fb23408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:35.995262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 555/1112] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:36.265182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b410-8815-4769-b569-cbee44a50ca6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:36.309653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:36.366455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b410-8815-4769-b569-cbee44a50ca6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:36.399149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964bbdd-df9c-483a-9261-68a77d88b247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:36.399768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964bbdd-df9c-483a-9261-68a77d88b247 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:36.400047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964bbdd-df9c-483a-9261-68a77d88b247 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:36.400319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964bbdd-df9c-483a-9261-68a77d88b247 None admin] PATH_INFO: `/v3/roles/f196d84ade534597912f4ce3ca3f36ee` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:36.401700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964bbdd-df9c-483a-9261-68a77d88b247 None admin] RBAC: Authorizing `identity:get_role(role_id=f196d84ade534597912f4ce3ca3f36ee)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:36.403066 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964bbdd-df9c-483a-9261-68a77d88b247 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:36.404380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 558/1113] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:36 2022] GET /identity/v3/roles/f196d84ade534597912f4ce3ca3f36ee => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:36.410211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60a0a4-78f0-4241-b9b3-10952fb23408 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:36.460573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:36.506736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60a0a4-78f0-4241-b9b3-10952fb23408 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:36.538947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776af1f8-4e02-46e5-ba2a-d8d23dfc272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:36.539512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776af1f8-4e02-46e5-ba2a-d8d23dfc272a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:36.539790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776af1f8-4e02-46e5-ba2a-d8d23dfc272a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:36.540062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776af1f8-4e02-46e5-ba2a-d8d23dfc272a None admin] PATH_INFO: `/v3/users/e69e84c10e3f4f8ba01558cb6d39025b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:36.553198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776af1f8-4e02-46e5-ba2a-d8d23dfc272a None admin] RBAC: Authorizing `identity:get_user(user_id=e69e84c10e3f4f8ba01558cb6d39025b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:36.554624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776af1f8-4e02-46e5-ba2a-d8d23dfc272a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:36.556212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 556/1114] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:36 2022] GET /identity/v3/users/e69e84c10e3f4f8ba01558cb6d39025b => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:36.562046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964bbdd-df9c-483a-9261-68a77d88b247 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:36.658643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964bbdd-df9c-483a-9261-68a77d88b247 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:36.668486 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:36.691787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66402a52-b924-44b2-ad07-9476186f15c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:36.692393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66402a52-b924-44b2-ad07-9476186f15c2 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:36.692703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66402a52-b924-44b2-ad07-9476186f15c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:36.692977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66402a52-b924-44b2-ad07-9476186f15c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:36.757959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66402a52-b924-44b2-ad07-9476186f15c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:36.759404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66402a52-b924-44b2-ad07-9476186f15c2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:36.854131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 559/1115] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:52:36.860595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776af1f8-4e02-46e5-ba2a-d8d23dfc272a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:36.955619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776af1f8-4e02-46e5-ba2a-d8d23dfc272a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:36.965781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:36.989817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72513d-a85a-4331-ac97-8035595244a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:36.990445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72513d-a85a-4331-ac97-8035595244a5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:36.990723 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72513d-a85a-4331-ac97-8035595244a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:36.990992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72513d-a85a-4331-ac97-8035595244a5 None admin] PATH_INFO: `/v3/projects/30da536aaf80437da7f59b272dd6a1da` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:36.992086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72513d-a85a-4331-ac97-8035595244a5 None admin] RBAC: Authorizing `identity:get_project(project_id=30da536aaf80437da7f59b272dd6a1da)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:36.993544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72513d-a85a-4331-ac97-8035595244a5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:36.995155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 557/1116] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:52:36 2022] GET /identity/v3/projects/30da536aaf80437da7f59b272dd6a1da => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:37.001588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66402a52-b924-44b2-ad07-9476186f15c2 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:37.012990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:37.100653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66402a52-b924-44b2-ad07-9476186f15c2 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:37.133703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02221a-a112-4fb2-87c1-2ad4ae08248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:37.134232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02221a-a112-4fb2-87c1-2ad4ae08248a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:37.134512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02221a-a112-4fb2-87c1-2ad4ae08248a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:37.134786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02221a-a112-4fb2-87c1-2ad4ae08248a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:37.135506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02221a-a112-4fb2-87c1-2ad4ae08248a None admin] RBAC: Adding query filter params (role.id=f196d84ade534597912f4ce3ca3f36ee, scope.project.id=30da536aaf80437da7f59b272dd6a1da, user.id=e69e84c10e3f4f8ba01558cb6d39025b) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:37.135816 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02221a-a112-4fb2-87c1-2ad4ae08248a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:37.137278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02221a-a112-4fb2-87c1-2ad4ae08248a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:37.143003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 560/1117] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:52:37 2022] GET /identity/v3/role_assignments?user.id=e69e84c10e3f4f8ba01558cb6d39025b&scope.project.id=30da536aaf80437da7f59b272dd6a1da&role.id=f196d84ade534597912f4ce3ca3f36ee => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:39.001023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224d1b-6dac-4dbe-b00d-a0b07229591e None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:39.001555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224d1b-6dac-4dbe-b00d-a0b07229591e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:39.001555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224d1b-6dac-4dbe-b00d-a0b07229591e None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:39.002821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 558/1118] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:39.007898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bde09-5f97-44ca-b64f-8e4bca2a0056 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:39.008301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bde09-5f97-44ca-b64f-8e4bca2a0056 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:39.008452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bde09-5f97-44ca-b64f-8e4bca2a0056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:39.027199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-720bde09-5f97-44ca-b64f-8e4bca2a0056 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:39.028369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-720bde09-5f97-44ca-b64f-8e4bca2a0056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:39.093754 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 561/1119] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:52:39.364772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224d1b-6dac-4dbe-b00d-a0b07229591e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:39.464520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224d1b-6dac-4dbe-b00d-a0b07229591e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:39.498352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb579-1895-480b-8e6a-db8cb309744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:39.498977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb579-1895-480b-8e6a-db8cb309744a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:39.499259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb579-1895-480b-8e6a-db8cb309744a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:39.499538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb579-1895-480b-8e6a-db8cb309744a None admin] PATH_INFO: `/v3/roles/f196d84ade534597912f4ce3ca3f36ee` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:39.500958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33eb579-1895-480b-8e6a-db8cb309744a None admin] RBAC: Authorizing `identity:get_role(role_id=f196d84ade534597912f4ce3ca3f36ee)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:39.502326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33eb579-1895-480b-8e6a-db8cb309744a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:39.503649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 559/1120] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:39 2022] GET /identity/v3/roles/f196d84ade534597912f4ce3ca3f36ee => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:39.509493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bde09-5f97-44ca-b64f-8e4bca2a0056 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:39.512562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:39.605430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bde09-5f97-44ca-b64f-8e4bca2a0056 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:39.637708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573631c8-0c16-4f95-bf6c-ffa95336f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:39.638267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573631c8-0c16-4f95-bf6c-ffa95336f160 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:39.638545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573631c8-0c16-4f95-bf6c-ffa95336f160 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:39.640016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573631c8-0c16-4f95-bf6c-ffa95336f160 None admin] PATH_INFO: `/v3/users/e69e84c10e3f4f8ba01558cb6d39025b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:39.641163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573631c8-0c16-4f95-bf6c-ffa95336f160 None admin] RBAC: Authorizing `identity:get_user(user_id=e69e84c10e3f4f8ba01558cb6d39025b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:39.642585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573631c8-0c16-4f95-bf6c-ffa95336f160 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:39.644159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 562/1121] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:39 2022] GET /identity/v3/users/e69e84c10e3f4f8ba01558cb6d39025b => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:39.650146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb579-1895-480b-8e6a-db8cb309744a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:39.695613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:39.748730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb579-1895-480b-8e6a-db8cb309744a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:39.781446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389375cb-e6f3-480d-88b2-825674d3a431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:39.782062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389375cb-e6f3-480d-88b2-825674d3a431 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:39.782342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389375cb-e6f3-480d-88b2-825674d3a431 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:39.782615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389375cb-e6f3-480d-88b2-825674d3a431 None admin] PATH_INFO: `/v3/projects/30da536aaf80437da7f59b272dd6a1da` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:39.783699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389375cb-e6f3-480d-88b2-825674d3a431 None admin] RBAC: Authorizing `identity:get_project(project_id=30da536aaf80437da7f59b272dd6a1da)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:39.785149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389375cb-e6f3-480d-88b2-825674d3a431 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:39.786759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 560/1122] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:52:39 2022] GET /identity/v3/projects/30da536aaf80437da7f59b272dd6a1da => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:39.792837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573631c8-0c16-4f95-bf6c-ffa95336f160 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:39.859947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:39.889453 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573631c8-0c16-4f95-bf6c-ffa95336f160 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:39.921894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d4b11-2348-49bc-82c6-e66c17d3b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:39.922546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4b11-2348-49bc-82c6-e66c17d3b3aa None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:39.922827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4b11-2348-49bc-82c6-e66c17d3b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:39.923102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4b11-2348-49bc-82c6-e66c17d3b3aa None admin] PATH_INFO: `/v3/projects/30da536aaf80437da7f59b272dd6a1da/users/e69e84c10e3f4f8ba01558cb6d39025b/roles/f196d84ade534597912f4ce3ca3f36ee` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:39.925223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d4b11-2348-49bc-82c6-e66c17d3b3aa None admin] RBAC: Authorizing `identity:create_grant(project_id=30da536aaf80437da7f59b272dd6a1da, user_id=e69e84c10e3f4f8ba01558cb6d39025b, role_id=f196d84ade534597912f4ce3ca3f36ee)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:39.926646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d4b11-2348-49bc-82c6-e66c17d3b3aa None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:39.940216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 563/1123] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:52:39 2022] PUT /identity/v3/projects/30da536aaf80437da7f59b272dd6a1da/users/e69e84c10e3f4f8ba01558cb6d39025b/roles/f196d84ade534597912f4ce3ca3f36ee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:52:41.808320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f855aa5-0666-47d1-a8df-18e210eaca0c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:41.808869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f855aa5-0666-47d1-a8df-18e210eaca0c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:41.808981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f855aa5-0666-47d1-a8df-18e210eaca0c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:41.810253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 561/1124] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:41.815526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb265df-847b-46b8-850f-e06c2a78a8b1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:41.815949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb265df-847b-46b8-850f-e06c2a78a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:41.816094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb265df-847b-46b8-850f-e06c2a78a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:41.834603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bbb265df-847b-46b8-850f-e06c2a78a8b1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:41.835827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bbb265df-847b-46b8-850f-e06c2a78a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:41.901534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 564/1125] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:42.166862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f855aa5-0666-47d1-a8df-18e210eaca0c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:42.266758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f855aa5-0666-47d1-a8df-18e210eaca0c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:42.280833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:42.301040 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9606f-f581-4166-a383-5478379823c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:42.301673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9606f-f581-4166-a383-5478379823c8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:42.301958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9606f-f581-4166-a383-5478379823c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:42.302236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9606f-f581-4166-a383-5478379823c8 None admin] PATH_INFO: `/v3/roles/f196d84ade534597912f4ce3ca3f36ee` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:42.303622 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9606f-f581-4166-a383-5478379823c8 None admin] RBAC: Authorizing `identity:get_role(role_id=f196d84ade534597912f4ce3ca3f36ee)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:42.305037 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9606f-f581-4166-a383-5478379823c8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:42.306387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 562/1126] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:42 2022] GET /identity/v3/roles/f196d84ade534597912f4ce3ca3f36ee => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:42.312586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb265df-847b-46b8-850f-e06c2a78a8b1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:42.371749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:42.414575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb265df-847b-46b8-850f-e06c2a78a8b1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:42.447743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258e207-3407-4d63-9f44-446d2acaa131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:42.448306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258e207-3407-4d63-9f44-446d2acaa131 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:42.448617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258e207-3407-4d63-9f44-446d2acaa131 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:42.448899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258e207-3407-4d63-9f44-446d2acaa131 None admin] PATH_INFO: `/v3/users/e69e84c10e3f4f8ba01558cb6d39025b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:42.450017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258e207-3407-4d63-9f44-446d2acaa131 None admin] RBAC: Authorizing `identity:get_user(user_id=e69e84c10e3f4f8ba01558cb6d39025b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:42.451453 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258e207-3407-4d63-9f44-446d2acaa131 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:42.453083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 565/1127] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:42 2022] GET /identity/v3/users/e69e84c10e3f4f8ba01558cb6d39025b => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:52:42.458937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9606f-f581-4166-a383-5478379823c8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:42.555708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9606f-f581-4166-a383-5478379823c8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:42.587635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36a818-e5f4-4b0f-bf84-86024af80d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:42.588230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a818-e5f4-4b0f-bf84-86024af80d79 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:42.588525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a818-e5f4-4b0f-bf84-86024af80d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:42.588802 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a818-e5f4-4b0f-bf84-86024af80d79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:42.635365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:42.653718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36a818-e5f4-4b0f-bf84-86024af80d79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:42.655712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36a818-e5f4-4b0f-bf84-86024af80d79 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:42.752115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 563/1128] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:52:42.758024 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258e207-3407-4d63-9f44-446d2acaa131 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:42.855841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258e207-3407-4d63-9f44-446d2acaa131 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:42.884024 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:42.890066 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7cd2-6181-4094-85bf-def09bc10357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:42.890697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7cd2-6181-4094-85bf-def09bc10357 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:42.890982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7cd2-6181-4094-85bf-def09bc10357 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:42.891261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7cd2-6181-4094-85bf-def09bc10357 None admin] PATH_INFO: `/v3/projects/30da536aaf80437da7f59b272dd6a1da` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:42.892375 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7cd2-6181-4094-85bf-def09bc10357 None admin] RBAC: Authorizing `identity:get_project(project_id=30da536aaf80437da7f59b272dd6a1da)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:42.893846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7cd2-6181-4094-85bf-def09bc10357 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:42.895469 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 566/1129] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:52:42 2022] GET /identity/v3/projects/30da536aaf80437da7f59b272dd6a1da => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:42.902518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36a818-e5f4-4b0f-bf84-86024af80d79 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:42.981291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:42.999970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36a818-e5f4-4b0f-bf84-86024af80d79 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:43.032562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acf699-c956-40f8-8a3d-23baa5af8c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:43.033152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acf699-c956-40f8-8a3d-23baa5af8c4b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:43.033434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acf699-c956-40f8-8a3d-23baa5af8c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:43.033715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acf699-c956-40f8-8a3d-23baa5af8c4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:43.034426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acf699-c956-40f8-8a3d-23baa5af8c4b None admin] RBAC: Adding query filter params (role.id=f196d84ade534597912f4ce3ca3f36ee, scope.project.id=30da536aaf80437da7f59b272dd6a1da, user.id=e69e84c10e3f4f8ba01558cb6d39025b) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:43.034736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acf699-c956-40f8-8a3d-23baa5af8c4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:43.036152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acf699-c956-40f8-8a3d-23baa5af8c4b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:43.041914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 564/1130] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:52:42 2022] GET /identity/v3/role_assignments?user.id=e69e84c10e3f4f8ba01558cb6d39025b&scope.project.id=30da536aaf80437da7f59b272dd6a1da&role.id=f196d84ade534597912f4ce3ca3f36ee => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:44.942676 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949e92-e7c7-47ff-aec7-d46766ac9a26 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:44.943226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949e92-e7c7-47ff-aec7-d46766ac9a26 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:44.943226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949e92-e7c7-47ff-aec7-d46766ac9a26 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:44.944570 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 567/1131] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:44.949790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3b257-e4a2-4842-9e5a-8c1c1c65ccf0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:44.950179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3b257-e4a2-4842-9e5a-8c1c1c65ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:44.950350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3b257-e4a2-4842-9e5a-8c1c1c65ccf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:44.969385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-20d3b257-e4a2-4842-9e5a-8c1c1c65ccf0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:44.970715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-20d3b257-e4a2-4842-9e5a-8c1c1c65ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:45.038785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 565/1132] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:45.305993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94949e92-e7c7-47ff-aec7-d46766ac9a26 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:45.405839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94949e92-e7c7-47ff-aec7-d46766ac9a26 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:45.438258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5511-be71-43ee-a9c8-ef1dec83e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:45.438881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5511-be71-43ee-a9c8-ef1dec83e293 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:45.439160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5511-be71-43ee-a9c8-ef1dec83e293 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:45.439432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5511-be71-43ee-a9c8-ef1dec83e293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:45.440553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a5511-be71-43ee-a9c8-ef1dec83e293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:45.441979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a5511-be71-43ee-a9c8-ef1dec83e293 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:45.443526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 568/1133] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:45.449464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3b257-e4a2-4842-9e5a-8c1c1c65ccf0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:45.528528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:45.551377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3b257-e4a2-4842-9e5a-8c1c1c65ccf0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:45.583913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeab29-4a91-4eed-a27c-a52fdc50199c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:45.584446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeab29-4a91-4eed-a27c-a52fdc50199c None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:45.584768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeab29-4a91-4eed-a27c-a52fdc50199c None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:45.585045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeab29-4a91-4eed-a27c-a52fdc50199c None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:45.585693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeab29-4a91-4eed-a27c-a52fdc50199c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:45.587123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeab29-4a91-4eed-a27c-a52fdc50199c None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:45.613506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 566/1134] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:52:45 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:47.538218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1884e-49e7-4c83-a098-ec17ad1ef182 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:47.538781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1884e-49e7-4c83-a098-ec17ad1ef182 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:47.538781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1884e-49e7-4c83-a098-ec17ad1ef182 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:47.540089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 569/1135] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:47.545790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67489-b3ae-463a-867a-1d39c7af1e58 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:47.546185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67489-b3ae-463a-867a-1d39c7af1e58 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:47.546352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67489-b3ae-463a-867a-1d39c7af1e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:47.564646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3ff67489-b3ae-463a-867a-1d39c7af1e58 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:47.565851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3ff67489-b3ae-463a-867a-1d39c7af1e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:47.631416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 567/1136] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:47.906334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1884e-49e7-4c83-a098-ec17ad1ef182 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:47.970851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:48.007121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1884e-49e7-4c83-a098-ec17ad1ef182 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:48.039422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b984b-022d-40ae-98d3-74c5087344e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:48.040039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b984b-022d-40ae-98d3-74c5087344e3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:48.040316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b984b-022d-40ae-98d3-74c5087344e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:48.040615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b984b-022d-40ae-98d3-74c5087344e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:48.041725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b984b-022d-40ae-98d3-74c5087344e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:48.043142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b984b-022d-40ae-98d3-74c5087344e3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:48.045250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 570/1137] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:52:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:48.051110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67489-b3ae-463a-867a-1d39c7af1e58 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:48.108046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:48.149373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67489-b3ae-463a-867a-1d39c7af1e58 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:48.181830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98856f-d21d-4bde-8f64-d655e141cecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:48.182433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98856f-d21d-4bde-8f64-d655e141cecc None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:48.182716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98856f-d21d-4bde-8f64-d655e141cecc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:48.182993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98856f-d21d-4bde-8f64-d655e141cecc None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:48.183621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98856f-d21d-4bde-8f64-d655e141cecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:48.185095 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98856f-d21d-4bde-8f64-d655e141cecc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:48.205753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 568/1138] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:52:48 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:52:50.121916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb6a48-de42-4aa6-9742-84795fa337f2 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:50.122423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb6a48-de42-4aa6-9742-84795fa337f2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:50.122423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb6a48-de42-4aa6-9742-84795fa337f2 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:50.123741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 571/1139] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:50.128857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d932-76c1-41fa-b8bf-e7c1d4ef2708 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:50.129275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d932-76c1-41fa-b8bf-e7c1d4ef2708 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:50.129413 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d932-76c1-41fa-b8bf-e7c1d4ef2708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:50.147658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3191d932-76c1-41fa-b8bf-e7c1d4ef2708 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:50.148862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3191d932-76c1-41fa-b8bf-e7c1d4ef2708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:50.212046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 569/1140] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:50.482099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb6a48-de42-4aa6-9742-84795fa337f2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:50.581102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb6a48-de42-4aa6-9742-84795fa337f2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:50.613586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256d413-bd65-4a6e-995c-fc86f6704b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:50.614209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256d413-bd65-4a6e-995c-fc86f6704b9a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:50.614491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256d413-bd65-4a6e-995c-fc86f6704b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:50.614765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256d413-bd65-4a6e-995c-fc86f6704b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:50.616608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:50.625688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256d413-bd65-4a6e-995c-fc86f6704b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0256d413-bd65-4a6e-995c-fc86f6704b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:50.630369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:50.631522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:50.632495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 572/1141] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:52:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:50.637625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191d932-76c1-41fa-b8bf-e7c1d4ef2708 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:50.681969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:50.738232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191d932-76c1-41fa-b8bf-e7c1d4ef2708 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:50.771174 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f2117-412f-4f8a-a086-cb96e12a3180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:50.771779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2117-412f-4f8a-a086-cb96e12a3180 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:50.772062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2117-412f-4f8a-a086-cb96e12a3180 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:50.772337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2117-412f-4f8a-a086-cb96e12a3180 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:50.773029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f2117-412f-4f8a-a086-cb96e12a3180 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:50.773337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f2117-412f-4f8a-a086-cb96e12a3180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:50.774709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f2117-412f-4f8a-a086-cb96e12a3180 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:50.782977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 570/1142] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:52:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:50.788855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256d413-bd65-4a6e-995c-fc86f6704b9a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:50.887436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256d413-bd65-4a6e-995c-fc86f6704b9a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:50.920045 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96ad14-8b11-4fad-9abe-8ef73062ffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:50.920692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96ad14-8b11-4fad-9abe-8ef73062ffab None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:50.920974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96ad14-8b11-4fad-9abe-8ef73062ffab None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:50.921248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96ad14-8b11-4fad-9abe-8ef73062ffab None admin] PATH_INFO: `/v3/users/e1f024ae5db04970b5c56c8fe5479f71` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:50.933795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96ad14-8b11-4fad-9abe-8ef73062ffab None admin] RBAC: Authorizing `identity:get_user(user_id=e1f024ae5db04970b5c56c8fe5479f71)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:50.935779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96ad14-8b11-4fad-9abe-8ef73062ffab None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:50.937390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 573/1143] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:50 2022] GET /identity/v3/users/e1f024ae5db04970b5c56c8fe5479f71 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:50.943350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f2117-412f-4f8a-a086-cb96e12a3180 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:51.039579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f2117-412f-4f8a-a086-cb96e12a3180 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:51.046737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:51.078904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d1d5-101e-43e8-8fa1-4c9b5e2b12bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:51.079508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d1d5-101e-43e8-8fa1-4c9b5e2b12bc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:51.079784 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d1d5-101e-43e8-8fa1-4c9b5e2b12bc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:51.080055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d1d5-101e-43e8-8fa1-4c9b5e2b12bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:51.144929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842d1d5-101e-43e8-8fa1-4c9b5e2b12bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:51.146361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842d1d5-101e-43e8-8fa1-4c9b5e2b12bc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:51.240863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 571/1144] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:52:51.246866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96ad14-8b11-4fad-9abe-8ef73062ffab None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:51.297765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:51.343229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96ad14-8b11-4fad-9abe-8ef73062ffab None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:51.377279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466aeb-acbc-4205-a561-419467ff7339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:51.377902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466aeb-acbc-4205-a561-419467ff7339 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:51.378184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466aeb-acbc-4205-a561-419467ff7339 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:51.378463 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466aeb-acbc-4205-a561-419467ff7339 None admin] PATH_INFO: `/v3/projects/5c22538f551140c1802ca956256207a0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:51.379579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc466aeb-acbc-4205-a561-419467ff7339 None admin] RBAC: Authorizing `identity:get_project(project_id=5c22538f551140c1802ca956256207a0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:51.381036 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc466aeb-acbc-4205-a561-419467ff7339 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:51.382649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 574/1145] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:52:51 2022] GET /identity/v3/projects/5c22538f551140c1802ca956256207a0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:51.388960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d1d5-101e-43e8-8fa1-4c9b5e2b12bc None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:51.397024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:51.488571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d1d5-101e-43e8-8fa1-4c9b5e2b12bc None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:51.520298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6229e39-3639-4b12-9b3d-fca4377fd25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:51.520921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229e39-3639-4b12-9b3d-fca4377fd25a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:51.521201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229e39-3639-4b12-9b3d-fca4377fd25a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:51.521474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229e39-3639-4b12-9b3d-fca4377fd25a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:51.522187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6229e39-3639-4b12-9b3d-fca4377fd25a None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=5c22538f551140c1802ca956256207a0, user.id=e1f024ae5db04970b5c56c8fe5479f71) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:51.522498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6229e39-3639-4b12-9b3d-fca4377fd25a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:51.523965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6229e39-3639-4b12-9b3d-fca4377fd25a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:51.529742 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 572/1146] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:52:51 2022] GET /identity/v3/role_assignments?user.id=e1f024ae5db04970b5c56c8fe5479f71&scope.project.id=5c22538f551140c1802ca956256207a0&role.id=56228137a4444ef9b7e688d04abd00fd => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:53.403682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da62da5-1f5c-4e2e-930d-e20ad25cb552 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:53.404807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da62da5-1f5c-4e2e-930d-e20ad25cb552 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:53.404807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da62da5-1f5c-4e2e-930d-e20ad25cb552 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:53.406143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 575/1147] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:53.411286 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c6f66-a2cb-4c11-8b3f-462b6268b326 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:53.411720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c6f66-a2cb-4c11-8b3f-462b6268b326 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:53.411824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c6f66-a2cb-4c11-8b3f-462b6268b326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:53.429407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-874c6f66-a2cb-4c11-8b3f-462b6268b326 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:53.430579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-874c6f66-a2cb-4c11-8b3f-462b6268b326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:53.491327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:53.496380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 573/1148] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:53.762230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da62da5-1f5c-4e2e-930d-e20ad25cb552 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:53.866644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da62da5-1f5c-4e2e-930d-e20ad25cb552 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:53.886716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:53.900881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7a99-11eb-4e22-b459-1f94eb08cdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:53.901513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7a99-11eb-4e22-b459-1f94eb08cdad None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:53.901799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7a99-11eb-4e22-b459-1f94eb08cdad None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:53.902073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7a99-11eb-4e22-b459-1f94eb08cdad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:53.911928 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7a99-11eb-4e22-b459-1f94eb08cdad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-072a7a99-11eb-4e22-b459-1f94eb08cdad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:53.916652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:53.917783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:52:53.918898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 576/1149] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:53.924242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c6f66-a2cb-4c11-8b3f-462b6268b326 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:54.020746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c6f66-a2cb-4c11-8b3f-462b6268b326 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:54.053315 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ed6a8-ab26-4928-b9c6-00c66ee38674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:54.053932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ed6a8-ab26-4928-b9c6-00c66ee38674 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:54.054218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ed6a8-ab26-4928-b9c6-00c66ee38674 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:54.054498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ed6a8-ab26-4928-b9c6-00c66ee38674 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:54.055178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ed6a8-ab26-4928-b9c6-00c66ee38674 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:54.055488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ed6a8-ab26-4928-b9c6-00c66ee38674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:54.057016 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ed6a8-ab26-4928-b9c6-00c66ee38674 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:54.066700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 574/1150] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:54.072729 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7a99-11eb-4e22-b459-1f94eb08cdad None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:54.168956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7a99-11eb-4e22-b459-1f94eb08cdad None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:54.202137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44789279-99c4-4c27-92f0-7571f5bb6d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:54.202753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44789279-99c4-4c27-92f0-7571f5bb6d7e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:54.203039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44789279-99c4-4c27-92f0-7571f5bb6d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:54.203312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44789279-99c4-4c27-92f0-7571f5bb6d7e None admin] PATH_INFO: `/v3/users/e1f024ae5db04970b5c56c8fe5479f71` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:54.204410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44789279-99c4-4c27-92f0-7571f5bb6d7e None admin] RBAC: Authorizing `identity:get_user(user_id=e1f024ae5db04970b5c56c8fe5479f71)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:54.205862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44789279-99c4-4c27-92f0-7571f5bb6d7e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:54.207418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 577/1151] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:54 2022] GET /identity/v3/users/e1f024ae5db04970b5c56c8fe5479f71 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:54.213232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ed6a8-ab26-4928-b9c6-00c66ee38674 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:54.272264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:54.310270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ed6a8-ab26-4928-b9c6-00c66ee38674 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:54.342130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197a413-048d-4985-9b4f-2a14dd51f692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:54.342752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197a413-048d-4985-9b4f-2a14dd51f692 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:54.343033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197a413-048d-4985-9b4f-2a14dd51f692 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:54.343308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197a413-048d-4985-9b4f-2a14dd51f692 None admin] PATH_INFO: `/v3/projects/5c22538f551140c1802ca956256207a0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:54.344411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197a413-048d-4985-9b4f-2a14dd51f692 None admin] RBAC: Authorizing `identity:get_project(project_id=5c22538f551140c1802ca956256207a0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:54.345941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197a413-048d-4985-9b4f-2a14dd51f692 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:54.347551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 575/1152] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:52:54 2022] GET /identity/v3/projects/5c22538f551140c1802ca956256207a0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:54.353552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44789279-99c4-4c27-92f0-7571f5bb6d7e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:54.402211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:54.454750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44789279-99c4-4c27-92f0-7571f5bb6d7e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:54.488600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f0fcc-ef1f-49d7-a483-4388f21bffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:54.489261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f0fcc-ef1f-49d7-a483-4388f21bffd2 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:54.489543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f0fcc-ef1f-49d7-a483-4388f21bffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:54.489815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f0fcc-ef1f-49d7-a483-4388f21bffd2 None admin] PATH_INFO: `/v3/projects/5c22538f551140c1802ca956256207a0/users/e1f024ae5db04970b5c56c8fe5479f71/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:54.491694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f0fcc-ef1f-49d7-a483-4388f21bffd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c22538f551140c1802ca956256207a0, user_id=e1f024ae5db04970b5c56c8fe5479f71, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:54.493152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f0fcc-ef1f-49d7-a483-4388f21bffd2 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:54.507612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 578/1153] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:52:54 2022] PUT /identity/v3/projects/5c22538f551140c1802ca956256207a0/users/e1f024ae5db04970b5c56c8fe5479f71/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:52:56.383595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd87b5-9e09-413c-9b8d-032d250f14c5 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:56.384178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd87b5-9e09-413c-9b8d-032d250f14c5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:56.384178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd87b5-9e09-413c-9b8d-032d250f14c5 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:56.385524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 576/1154] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:56.391964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c0150-d4c6-4d23-93c5-b1ae69e4f53b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:56.392357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c0150-d4c6-4d23-93c5-b1ae69e4f53b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:56.392544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c0150-d4c6-4d23-93c5-b1ae69e4f53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:56.410587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-585c0150-d4c6-4d23-93c5-b1ae69e4f53b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:56.411753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-585c0150-d4c6-4d23-93c5-b1ae69e4f53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:56.476520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 579/1155] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:52:56.744676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd87b5-9e09-413c-9b8d-032d250f14c5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:56.843934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd87b5-9e09-413c-9b8d-032d250f14c5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:56.871241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:56.877497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a802d-55bd-4c30-892c-8329b33bff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:56.878119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a802d-55bd-4c30-892c-8329b33bff50 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:56.878400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a802d-55bd-4c30-892c-8329b33bff50 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:56.878675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a802d-55bd-4c30-892c-8329b33bff50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:56.888939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a802d-55bd-4c30-892c-8329b33bff50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8d4a802d-55bd-4c30-892c-8329b33bff50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:52:56.893531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:52:56.895096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:52:56.896226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 577/1156] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:52:56.900670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c0150-d4c6-4d23-93c5-b1ae69e4f53b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:56.939222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:56.998236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c0150-d4c6-4d23-93c5-b1ae69e4f53b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:57.032052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021efd-ecfe-4df9-9d93-73a8d676b514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:57.032691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021efd-ecfe-4df9-9d93-73a8d676b514 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:57.032976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021efd-ecfe-4df9-9d93-73a8d676b514 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:57.033252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021efd-ecfe-4df9-9d93-73a8d676b514 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:57.033909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f021efd-ecfe-4df9-9d93-73a8d676b514 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:57.034214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f021efd-ecfe-4df9-9d93-73a8d676b514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:57.035573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f021efd-ecfe-4df9-9d93-73a8d676b514 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:57.043478 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 580/1157] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:57.049800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a802d-55bd-4c30-892c-8329b33bff50 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:57.152116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a802d-55bd-4c30-892c-8329b33bff50 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:57.185534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235f6a0-7a4a-4799-96db-71d03800cf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:57.186158 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235f6a0-7a4a-4799-96db-71d03800cf9f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:57.186444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235f6a0-7a4a-4799-96db-71d03800cf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:57.186719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235f6a0-7a4a-4799-96db-71d03800cf9f None admin] PATH_INFO: `/v3/users/e1f024ae5db04970b5c56c8fe5479f71` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:57.187833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235f6a0-7a4a-4799-96db-71d03800cf9f None admin] RBAC: Authorizing `identity:get_user(user_id=e1f024ae5db04970b5c56c8fe5479f71)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:57.189295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235f6a0-7a4a-4799-96db-71d03800cf9f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:57.190874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 578/1158] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:52:57 2022] GET /identity/v3/users/e1f024ae5db04970b5c56c8fe5479f71 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:57.196851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021efd-ecfe-4df9-9d93-73a8d676b514 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:57.291196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:57.294290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021efd-ecfe-4df9-9d93-73a8d676b514 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:57.328126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793abfe2-28c8-4f94-a5b3-4157a81d96da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:57.328753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793abfe2-28c8-4f94-a5b3-4157a81d96da None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:57.329031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793abfe2-28c8-4f94-a5b3-4157a81d96da None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:57.329300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793abfe2-28c8-4f94-a5b3-4157a81d96da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:57.394132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793abfe2-28c8-4f94-a5b3-4157a81d96da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:57.395561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793abfe2-28c8-4f94-a5b3-4157a81d96da None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:57.485687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:57.491681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 581/1159] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:52:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:52:57.495708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235f6a0-7a4a-4799-96db-71d03800cf9f None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:57.552438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:57.593258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235f6a0-7a4a-4799-96db-71d03800cf9f None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:57.627072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1f74f-5b39-4e93-bfce-63475ecc9983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:57.627698 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1f74f-5b39-4e93-bfce-63475ecc9983 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:57.627985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1f74f-5b39-4e93-bfce-63475ecc9983 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:57.628268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1f74f-5b39-4e93-bfce-63475ecc9983 None admin] PATH_INFO: `/v3/projects/5c22538f551140c1802ca956256207a0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:57.629409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1f74f-5b39-4e93-bfce-63475ecc9983 None admin] RBAC: Authorizing `identity:get_project(project_id=5c22538f551140c1802ca956256207a0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:57.630844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1f74f-5b39-4e93-bfce-63475ecc9983 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:57.632541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 579/1160] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:52:57 2022] GET /identity/v3/projects/5c22538f551140c1802ca956256207a0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:57.638609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793abfe2-28c8-4f94-a5b3-4157a81d96da None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:52:57.734677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793abfe2-28c8-4f94-a5b3-4157a81d96da None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:52:57.768682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cf5d5-0c42-458b-b31a-14581de27a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:52:57.769292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cf5d5-0c42-458b-b31a-14581de27a53 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:57.769573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cf5d5-0c42-458b-b31a-14581de27a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:57.769915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cf5d5-0c42-458b-b31a-14581de27a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:57.770913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cf5d5-0c42-458b-b31a-14581de27a53 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=5c22538f551140c1802ca956256207a0, user.id=e1f024ae5db04970b5c56c8fe5479f71) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:52:57.771396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cf5d5-0c42-458b-b31a-14581de27a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:52:57.772849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cf5d5-0c42-458b-b31a-14581de27a53 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:52:57.778521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 582/1161] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:52:57 2022] GET /identity/v3/role_assignments?user.id=e1f024ae5db04970b5c56c8fe5479f71&scope.project.id=5c22538f551140c1802ca956256207a0&role.id=56228137a4444ef9b7e688d04abd00fd => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:52:59.691169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4addb-1ad2-404d-a574-b2b66810903c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:59.691747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4addb-1ad2-404d-a574-b2b66810903c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:59.691747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4addb-1ad2-404d-a574-b2b66810903c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:59.693129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 580/1162] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:52:59.698164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5262cb9-e268-4012-9229-fdd0ab56988d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:52:59.698572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5262cb9-e268-4012-9229-fdd0ab56988d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:52:59.698723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5262cb9-e268-4012-9229-fdd0ab56988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:52:59.717295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c5262cb9-e268-4012-9229-fdd0ab56988d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:52:59.718475 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c5262cb9-e268-4012-9229-fdd0ab56988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:52:59.776402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:52:59.784870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 583/1163] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:52:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:53:00.050660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4addb-1ad2-404d-a574-b2b66810903c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:00.151450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4addb-1ad2-404d-a574-b2b66810903c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:00.176475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:00.186056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c3e16-7e5a-49fe-81eb-50a41fafc2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:00.186664 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c3e16-7e5a-49fe-81eb-50a41fafc2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:00.186968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c3e16-7e5a-49fe-81eb-50a41fafc2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:00.187228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c3e16-7e5a-49fe-81eb-50a41fafc2a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:00.252608 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c3e16-7e5a-49fe-81eb-50a41fafc2a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:00.254061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c3e16-7e5a-49fe-81eb-50a41fafc2a3 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:00.348847 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 581/1164] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:53:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:53:00.354739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5262cb9-e268-4012-9229-fdd0ab56988d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:00.450371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5262cb9-e268-4012-9229-fdd0ab56988d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:00.483455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc497b-aa92-4338-9981-e6d3ea71f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:00.484078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc497b-aa92-4338-9981-e6d3ea71f958 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:00.484358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc497b-aa92-4338-9981-e6d3ea71f958 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:00.484659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc497b-aa92-4338-9981-e6d3ea71f958 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:00.491400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc497b-aa92-4338-9981-e6d3ea71f958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:00.492863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc497b-aa92-4338-9981-e6d3ea71f958 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-f3bc497b-aa92-4338-9981-e6d3ea71f958 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:53:00.503901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:53:00.505114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:53:00.506026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 584/1165] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Aug 18 16:53:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:53:00.511178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c3e16-7e5a-49fe-81eb-50a41fafc2a3 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:00.537263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:00.608154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c3e16-7e5a-49fe-81eb-50a41fafc2a3 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:00.641224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65f9a3-e083-4136-be72-f92485661850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:00.641823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65f9a3-e083-4136-be72-f92485661850 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:00.642103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65f9a3-e083-4136-be72-f92485661850 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:00.642379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65f9a3-e083-4136-be72-f92485661850 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:00.643015 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65f9a3-e083-4136-be72-f92485661850 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:53:00.643320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65f9a3-e083-4136-be72-f92485661850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:00.644704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65f9a3-e083-4136-be72-f92485661850 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:00.651525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 582/1166] 10.222.0.81 () {56 vars in 1115 bytes} [Thu Aug 18 16:53:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:02.537310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298955a-15a9-4a48-9070-ee31a690f2cc None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:02.537877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298955a-15a9-4a48-9070-ee31a690f2cc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:02.537877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298955a-15a9-4a48-9070-ee31a690f2cc None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:02.539208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 585/1167] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:53:02.544785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7153-ae2b-47fd-9c5e-51c3f6829f68 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:02.545226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7153-ae2b-47fd-9c5e-51c3f6829f68 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:02.545349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7153-ae2b-47fd-9c5e-51c3f6829f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:02.563486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-435f7153-ae2b-47fd-9c5e-51c3f6829f68 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:53:02.564697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-435f7153-ae2b-47fd-9c5e-51c3f6829f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:53:02.629225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 583/1168] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:53:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:53:02.905694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298955a-15a9-4a48-9070-ee31a690f2cc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:02.961986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:03.009296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298955a-15a9-4a48-9070-ee31a690f2cc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:03.043206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9820801-089a-482f-ae36-3d872b2956f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:03.043803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820801-089a-482f-ae36-3d872b2956f4 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:03.044104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820801-089a-482f-ae36-3d872b2956f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:03.044373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820801-089a-482f-ae36-3d872b2956f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:03.045046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9820801-089a-482f-ae36-3d872b2956f4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:03.046412 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9820801-089a-482f-ae36-3d872b2956f4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:03.063004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 586/1169] 10.222.0.81 () {60 vars in 1138 bytes} [Thu Aug 18 16:53:02 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:53:04.962962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93fb1-3795-42b4-8444-07a9aee1e2c3 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:04.963487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93fb1-3795-42b4-8444-07a9aee1e2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:04.963575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a93fb1-3795-42b4-8444-07a9aee1e2c3 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:04.964904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 584/1170] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:53:04.971127 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744e66d-4dfd-4776-b967-a75cd57c6ab7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:04.971580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744e66d-4dfd-4776-b967-a75cd57c6ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:04.971771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744e66d-4dfd-4776-b967-a75cd57c6ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:04.990798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0744e66d-4dfd-4776-b967-a75cd57c6ab7 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:53:04.991914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0744e66d-4dfd-4776-b967-a75cd57c6ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:53:05.058473 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 587/1171] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:53:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:53:05.325541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a93fb1-3795-42b4-8444-07a9aee1e2c3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:05.348094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:05.426476 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a93fb1-3795-42b4-8444-07a9aee1e2c3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:05.461276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa01b4-4676-404b-828f-ddf962fb6ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:05.461911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa01b4-4676-404b-828f-ddf962fb6ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:05.462192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa01b4-4676-404b-828f-ddf962fb6ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:05.462474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa01b4-4676-404b-828f-ddf962fb6ca1 None admin] PATH_INFO: `/v3/domains/aca3a1c91ac845d6b43733f9d440ba41` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:05.473107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa01b4-4676-404b-828f-ddf962fb6ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=aca3a1c91ac845d6b43733f9d440ba41)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:05.474540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa01b4-4676-404b-828f-ddf962fb6ca1 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:05.476133 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 585/1172] 10.222.0.81 () {56 vars in 1183 bytes} [Thu Aug 18 16:53:05 2022] GET /identity/v3/domains/aca3a1c91ac845d6b43733f9d440ba41 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:05.482620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744e66d-4dfd-4776-b967-a75cd57c6ab7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:05.525453 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:05.578138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744e66d-4dfd-4776-b967-a75cd57c6ab7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:05.610358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee02ac-ec63-4514-b1f4-42ea91dfcfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:05.610962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee02ac-ec63-4514-b1f4-42ea91dfcfb8 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:05.611238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee02ac-ec63-4514-b1f4-42ea91dfcfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:05.611510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee02ac-ec63-4514-b1f4-42ea91dfcfb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:05.612402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee02ac-ec63-4514-b1f4-42ea91dfcfb8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:05.613844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee02ac-ec63-4514-b1f4-42ea91dfcfb8 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:05.639315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 588/1173] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:53:05 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:53:07.532586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1659b-a73c-4631-a0f3-f9eda8af066c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:07.533194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1659b-a73c-4631-a0f3-f9eda8af066c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:07.533194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1659b-a73c-4631-a0f3-f9eda8af066c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:07.534533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 586/1174] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:53:07.540021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622215a1-66cc-45d4-a1bd-9fc950daf98f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:07.540621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622215a1-66cc-45d4-a1bd-9fc950daf98f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:07.540621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622215a1-66cc-45d4-a1bd-9fc950daf98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:07.558929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-622215a1-66cc-45d4-a1bd-9fc950daf98f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:53:07.560166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-622215a1-66cc-45d4-a1bd-9fc950daf98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:53:07.626194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 589/1175] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:53:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:53:07.896122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1659b-a73c-4631-a0f3-f9eda8af066c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:07.976755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:07.997471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1659b-a73c-4631-a0f3-f9eda8af066c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:08.037053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7d153-290d-41ed-974b-fb1a24829d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:08.037683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7d153-290d-41ed-974b-fb1a24829d70 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:08.037965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7d153-290d-41ed-974b-fb1a24829d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:08.038233 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7d153-290d-41ed-974b-fb1a24829d70 None admin] PATH_INFO: `/v3/domains/aca3a1c91ac845d6b43733f9d440ba41` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:08.039326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7d153-290d-41ed-974b-fb1a24829d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=aca3a1c91ac845d6b43733f9d440ba41)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:08.040782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7d153-290d-41ed-974b-fb1a24829d70 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:08.042344 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 587/1176] 10.222.0.81 () {56 vars in 1183 bytes} [Thu Aug 18 16:53:07 2022] GET /identity/v3/domains/aca3a1c91ac845d6b43733f9d440ba41 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:08.048875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622215a1-66cc-45d4-a1bd-9fc950daf98f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:08.081204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:08.151522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622215a1-66cc-45d4-a1bd-9fc950daf98f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:08.185983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9f4f2-5f6b-4426-b9d7-70c596202274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:08.186593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9f4f2-5f6b-4426-b9d7-70c596202274 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:08.186875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9f4f2-5f6b-4426-b9d7-70c596202274 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:08.187152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9f4f2-5f6b-4426-b9d7-70c596202274 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:08.187799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9f4f2-5f6b-4426-b9d7-70c596202274 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:08.189257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9f4f2-5f6b-4426-b9d7-70c596202274 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:08.209664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 590/1177] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:53:08 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:53:10.228382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbe934-88d7-41b2-b826-a338f3d211b8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:10.228987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbe934-88d7-41b2-b826-a338f3d211b8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:10.228987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbe934-88d7-41b2-b826-a338f3d211b8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:10.230321 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 588/1178] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:53:10.235998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f5dd4-3ee7-418c-8859-72175f16d25d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:10.236439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f5dd4-3ee7-418c-8859-72175f16d25d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:10.236610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f5dd4-3ee7-418c-8859-72175f16d25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:10.254458 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-293f5dd4-3ee7-418c-8859-72175f16d25d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:53:10.255789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-293f5dd4-3ee7-418c-8859-72175f16d25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:53:10.319551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 591/1179] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:53:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:53:10.587484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbe934-88d7-41b2-b826-a338f3d211b8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:10.687217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbe934-88d7-41b2-b826-a338f3d211b8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:10.720788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9343f31-00d0-4612-924c-4cfad24f6b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:10.721421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9343f31-00d0-4612-924c-4cfad24f6b61 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:10.721703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9343f31-00d0-4612-924c-4cfad24f6b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:10.721978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9343f31-00d0-4612-924c-4cfad24f6b61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:10.732578 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9343f31-00d0-4612-924c-4cfad24f6b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-d9343f31-00d0-4612-924c-4cfad24f6b61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:53:10.737525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:53:10.738546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:53:10.739486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 589/1180] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:53:10.744709 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f5dd4-3ee7-418c-8859-72175f16d25d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:10.758484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:10.840005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f5dd4-3ee7-418c-8859-72175f16d25d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:10.873007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29c585-f2b0-4b43-82c6-515dcc663f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:10.873598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c585-f2b0-4b43-82c6-515dcc663f70 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:10.873884 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c585-f2b0-4b43-82c6-515dcc663f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:10.874149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c585-f2b0-4b43-82c6-515dcc663f70 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:10.874796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29c585-f2b0-4b43-82c6-515dcc663f70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:53:10.875094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29c585-f2b0-4b43-82c6-515dcc663f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:10.876441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29c585-f2b0-4b43-82c6-515dcc663f70 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:10.884158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 592/1181] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:53:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:10.890007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9343f31-00d0-4612-924c-4cfad24f6b61 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:10.901130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:10.993970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9343f31-00d0-4612-924c-4cfad24f6b61 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:11.025921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275c450-b26a-4230-b6c3-38168ac6c8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:11.026547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275c450-b26a-4230-b6c3-38168ac6c8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:11.026829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275c450-b26a-4230-b6c3-38168ac6c8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:11.027104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275c450-b26a-4230-b6c3-38168ac6c8d0 None admin] PATH_INFO: `/v3/users/c639a5a0a71b4ea68b06a3e56b9a4f66` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:11.040102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275c450-b26a-4230-b6c3-38168ac6c8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=c639a5a0a71b4ea68b06a3e56b9a4f66)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:11.041564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275c450-b26a-4230-b6c3-38168ac6c8d0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:11.043138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 590/1182] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:53:10 2022] GET /identity/v3/users/c639a5a0a71b4ea68b06a3e56b9a4f66 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:11.049770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29c585-f2b0-4b43-82c6-515dcc663f70 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:11.124858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:11.149743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29c585-f2b0-4b43-82c6-515dcc663f70 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:11.181930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e560e-9c32-4b0a-ae4f-5255eaf42bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:11.182530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e560e-9c32-4b0a-ae4f-5255eaf42bee None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:11.182809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e560e-9c32-4b0a-ae4f-5255eaf42bee None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:11.183081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e560e-9c32-4b0a-ae4f-5255eaf42bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:11.246986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e560e-9c32-4b0a-ae4f-5255eaf42bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:11.248416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e560e-9c32-4b0a-ae4f-5255eaf42bee None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:11.318600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:11.344263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 593/1183] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:53:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:53:11.350186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275c450-b26a-4230-b6c3-38168ac6c8d0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:11.414426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:11.450627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275c450-b26a-4230-b6c3-38168ac6c8d0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:11.483079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a1d3c-36aa-4a01-baf6-16351761c1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:11.483716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1d3c-36aa-4a01-baf6-16351761c1cc None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:11.483998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1d3c-36aa-4a01-baf6-16351761c1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:11.484274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1d3c-36aa-4a01-baf6-16351761c1cc None admin] PATH_INFO: `/v3/projects/e9d769bc86e0487ea65985385b6e43f3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:11.485400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a1d3c-36aa-4a01-baf6-16351761c1cc None admin] RBAC: Authorizing `identity:get_project(project_id=e9d769bc86e0487ea65985385b6e43f3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:11.487097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a1d3c-36aa-4a01-baf6-16351761c1cc None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:11.488765 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 591/1184] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:53:11 2022] GET /identity/v3/projects/e9d769bc86e0487ea65985385b6e43f3 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:11.494879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e560e-9c32-4b0a-ae4f-5255eaf42bee None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:11.592120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e560e-9c32-4b0a-ae4f-5255eaf42bee None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:11.625253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9c4f9-04d2-4934-973d-132c8baee3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:11.625857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9c4f9-04d2-4934-973d-132c8baee3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:11.626139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9c4f9-04d2-4934-973d-132c8baee3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:11.626414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9c4f9-04d2-4934-973d-132c8baee3e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:11.627130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9c4f9-04d2-4934-973d-132c8baee3e5 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=e9d769bc86e0487ea65985385b6e43f3, user.id=c639a5a0a71b4ea68b06a3e56b9a4f66) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:53:11.627439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9c4f9-04d2-4934-973d-132c8baee3e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:11.628889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9c4f9-04d2-4934-973d-132c8baee3e5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:11.634090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 594/1185] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:53:11 2022] GET /identity/v3/role_assignments?user.id=c639a5a0a71b4ea68b06a3e56b9a4f66&scope.project.id=e9d769bc86e0487ea65985385b6e43f3&role.id=56228137a4444ef9b7e688d04abd00fd => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:13.507224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62075-cc62-405c-aa89-2dad65637a19 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:13.507768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62075-cc62-405c-aa89-2dad65637a19 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:13.507768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62075-cc62-405c-aa89-2dad65637a19 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:13.509227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 592/1186] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:53:13.514828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9a26-efbd-4060-bffa-6350bee0a982 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:13.515240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9a26-efbd-4060-bffa-6350bee0a982 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:13.515384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9a26-efbd-4060-bffa-6350bee0a982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:13.533563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2f2e9a26-efbd-4060-bffa-6350bee0a982 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:53:13.534736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2f2e9a26-efbd-4060-bffa-6350bee0a982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:53:13.562968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:13.599979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 595/1187] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:53:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:53:13.870224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f62075-cc62-405c-aa89-2dad65637a19 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:13.971433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f62075-cc62-405c-aa89-2dad65637a19 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:14.005658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830d3ec-3ed4-46d3-91ee-34896f6da8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:14.006282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830d3ec-3ed4-46d3-91ee-34896f6da8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:14.006560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830d3ec-3ed4-46d3-91ee-34896f6da8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:14.006831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830d3ec-3ed4-46d3-91ee-34896f6da8e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:14.008663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:14.017367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830d3ec-3ed4-46d3-91ee-34896f6da8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-f830d3ec-3ed4-46d3-91ee-34896f6da8e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:53:14.021982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:53:14.023295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:53:14.024360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 593/1188] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:53:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:53:14.029619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9a26-efbd-4060-bffa-6350bee0a982 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:14.133606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9a26-efbd-4060-bffa-6350bee0a982 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:14.166631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155f017-3624-4462-8b3b-5bd084405f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:14.167230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155f017-3624-4462-8b3b-5bd084405f8c None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:14.167509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155f017-3624-4462-8b3b-5bd084405f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:14.167784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155f017-3624-4462-8b3b-5bd084405f8c None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:14.168500 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155f017-3624-4462-8b3b-5bd084405f8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:53:14.168809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155f017-3624-4462-8b3b-5bd084405f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:14.170229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155f017-3624-4462-8b3b-5bd084405f8c None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:14.178268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 596/1189] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:14.184196 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830d3ec-3ed4-46d3-91ee-34896f6da8e5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:14.285111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830d3ec-3ed4-46d3-91ee-34896f6da8e5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:14.317291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc90410-10b6-4c6f-a542-027deef27317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:14.317906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90410-10b6-4c6f-a542-027deef27317 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:14.318187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90410-10b6-4c6f-a542-027deef27317 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:14.318457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90410-10b6-4c6f-a542-027deef27317 None admin] PATH_INFO: `/v3/users/c639a5a0a71b4ea68b06a3e56b9a4f66` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:14.319549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc90410-10b6-4c6f-a542-027deef27317 None admin] RBAC: Authorizing `identity:get_user(user_id=c639a5a0a71b4ea68b06a3e56b9a4f66)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:14.320996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc90410-10b6-4c6f-a542-027deef27317 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:14.322564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 594/1190] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:53:14 2022] GET /identity/v3/users/c639a5a0a71b4ea68b06a3e56b9a4f66 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:14.329139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155f017-3624-4462-8b3b-5bd084405f8c None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:14.359145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:14.426511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155f017-3624-4462-8b3b-5bd084405f8c None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:14.459676 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4bfba-1a21-4319-a138-7baba29272cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:14.460303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4bfba-1a21-4319-a138-7baba29272cd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:14.460607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4bfba-1a21-4319-a138-7baba29272cd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:14.460880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4bfba-1a21-4319-a138-7baba29272cd None admin] PATH_INFO: `/v3/projects/e9d769bc86e0487ea65985385b6e43f3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:14.461975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4bfba-1a21-4319-a138-7baba29272cd None admin] RBAC: Authorizing `identity:get_project(project_id=e9d769bc86e0487ea65985385b6e43f3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:14.463392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4bfba-1a21-4319-a138-7baba29272cd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:14.465195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 597/1191] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:53:14 2022] GET /identity/v3/projects/e9d769bc86e0487ea65985385b6e43f3 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:14.471370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc90410-10b6-4c6f-a542-027deef27317 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:14.530945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:14.568999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc90410-10b6-4c6f-a542-027deef27317 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:14.601163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ed44-f59d-4ca1-bf07-4a3581f1e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:14.601820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ed44-f59d-4ca1-bf07-4a3581f1e55f None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:14.602102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ed44-f59d-4ca1-bf07-4a3581f1e55f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:14.602379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ed44-f59d-4ca1-bf07-4a3581f1e55f None admin] PATH_INFO: `/v3/projects/e9d769bc86e0487ea65985385b6e43f3/users/c639a5a0a71b4ea68b06a3e56b9a4f66/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:14.604273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6ed44-f59d-4ca1-bf07-4a3581f1e55f None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d769bc86e0487ea65985385b6e43f3, user_id=c639a5a0a71b4ea68b06a3e56b9a4f66, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:14.605727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6ed44-f59d-4ca1-bf07-4a3581f1e55f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:14.618144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 595/1192] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:53:14 2022] PUT /identity/v3/projects/e9d769bc86e0487ea65985385b6e43f3/users/c639a5a0a71b4ea68b06a3e56b9a4f66/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 16:53:16.514402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86f6ee-413e-409b-99d0-dc46fd49a853 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:16.514967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86f6ee-413e-409b-99d0-dc46fd49a853 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:16.514967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86f6ee-413e-409b-99d0-dc46fd49a853 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:16.516283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 598/1193] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:53:16.521663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa683d8-029b-4cfa-bacb-f752c43b787e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:16.522070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa683d8-029b-4cfa-bacb-f752c43b787e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:16.522339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa683d8-029b-4cfa-bacb-f752c43b787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:16.540854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4aa683d8-029b-4cfa-bacb-f752c43b787e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:53:16.542029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4aa683d8-029b-4cfa-bacb-f752c43b787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:53:16.606915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 596/1194] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:53:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:53:16.872746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86f6ee-413e-409b-99d0-dc46fd49a853 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:16.967816 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:16.973625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86f6ee-413e-409b-99d0-dc46fd49a853 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:17.006880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34afe9-3958-4745-a588-8963a210c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:17.007517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34afe9-3958-4745-a588-8963a210c69a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:17.007799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34afe9-3958-4745-a588-8963a210c69a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:17.008077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34afe9-3958-4745-a588-8963a210c69a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:17.017809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34afe9-3958-4745-a588-8963a210c69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-da34afe9-3958-4745-a588-8963a210c69a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:53:17.022526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:53:17.023655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:53:17.024732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 599/1195] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:53:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:53:17.030215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa683d8-029b-4cfa-bacb-f752c43b787e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:17.081917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:17.127219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa683d8-029b-4cfa-bacb-f752c43b787e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:17.160057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ccf44-5567-4bc5-8366-b67e4cc7d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:17.160682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ccf44-5567-4bc5-8366-b67e4cc7d84b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:17.160963 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ccf44-5567-4bc5-8366-b67e4cc7d84b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:17.161235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ccf44-5567-4bc5-8366-b67e4cc7d84b None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:17.161885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ccf44-5567-4bc5-8366-b67e4cc7d84b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:53:17.162186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ccf44-5567-4bc5-8366-b67e4cc7d84b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:17.163541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ccf44-5567-4bc5-8366-b67e4cc7d84b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:17.171244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 597/1196] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:53:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:17.177076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34afe9-3958-4745-a588-8963a210c69a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:17.274712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34afe9-3958-4745-a588-8963a210c69a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:17.307834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079c61-a146-41b3-8d4b-9a19fff38769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:17.308488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079c61-a146-41b3-8d4b-9a19fff38769 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:17.308789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079c61-a146-41b3-8d4b-9a19fff38769 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:17.309069 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079c61-a146-41b3-8d4b-9a19fff38769 None admin] PATH_INFO: `/v3/users/c639a5a0a71b4ea68b06a3e56b9a4f66` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:17.310176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64079c61-a146-41b3-8d4b-9a19fff38769 None admin] RBAC: Authorizing `identity:get_user(user_id=c639a5a0a71b4ea68b06a3e56b9a4f66)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:17.311596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64079c61-a146-41b3-8d4b-9a19fff38769 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:17.313191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 600/1197] 10.222.0.81 () {56 vars in 1177 bytes} [Thu Aug 18 16:53:17 2022] GET /identity/v3/users/c639a5a0a71b4ea68b06a3e56b9a4f66 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:17.319237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ccf44-5567-4bc5-8366-b67e4cc7d84b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:17.417740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ccf44-5567-4bc5-8366-b67e4cc7d84b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:17.431364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:17.451823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120f89a-3f0d-4887-86e7-95db9ed9eb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:17.452433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120f89a-3f0d-4887-86e7-95db9ed9eb7e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:17.452747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120f89a-3f0d-4887-86e7-95db9ed9eb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:17.453026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120f89a-3f0d-4887-86e7-95db9ed9eb7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:17.518599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120f89a-3f0d-4887-86e7-95db9ed9eb7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:17.520048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120f89a-3f0d-4887-86e7-95db9ed9eb7e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:17.617180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 598/1198] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:53:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:53:17.623411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079c61-a146-41b3-8d4b-9a19fff38769 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:17.649914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:17.719617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079c61-a146-41b3-8d4b-9a19fff38769 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:17.752732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40993d40-5891-4ed5-be1f-a637e047302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:17.753365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40993d40-5891-4ed5-be1f-a637e047302a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:17.753645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40993d40-5891-4ed5-be1f-a637e047302a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:17.753919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40993d40-5891-4ed5-be1f-a637e047302a None admin] PATH_INFO: `/v3/projects/e9d769bc86e0487ea65985385b6e43f3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:17.755098 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40993d40-5891-4ed5-be1f-a637e047302a None admin] RBAC: Authorizing `identity:get_project(project_id=e9d769bc86e0487ea65985385b6e43f3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:17.756550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40993d40-5891-4ed5-be1f-a637e047302a None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:17.758171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 601/1199] 10.222.0.81 () {56 vars in 1186 bytes} [Thu Aug 18 16:53:17 2022] GET /identity/v3/projects/e9d769bc86e0487ea65985385b6e43f3 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:17.765037 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120f89a-3f0d-4887-86e7-95db9ed9eb7e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:53:17.779482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:17.862078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120f89a-3f0d-4887-86e7-95db9ed9eb7e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:53:17.894798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ced4f-c14b-4b55-beaf-9c07833cefe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:53:17.895393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ced4f-c14b-4b55-beaf-9c07833cefe6 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:53:17.895672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ced4f-c14b-4b55-beaf-9c07833cefe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:53:17.895943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ced4f-c14b-4b55-beaf-9c07833cefe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:53:17.896687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ced4f-c14b-4b55-beaf-9c07833cefe6 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=e9d769bc86e0487ea65985385b6e43f3, user.id=c639a5a0a71b4ea68b06a3e56b9a4f66) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:53:17.896997 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ced4f-c14b-4b55-beaf-9c07833cefe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:53:17.898439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ced4f-c14b-4b55-beaf-9c07833cefe6 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:53:17.905061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 599/1200] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:53:17 2022] GET /identity/v3/role_assignments?user.id=c639a5a0a71b4ea68b06a3e56b9a4f66&scope.project.id=e9d769bc86e0487ea65985385b6e43f3&role.id=56228137a4444ef9b7e688d04abd00fd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:53:27.748912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=53 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:53:27.901473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=61 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:13.553745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ecb8-863a-4774-a918-986cec9401bb None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:13.553745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ecb8-863a-4774-a918-986cec9401bb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:13.554656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ecb8-863a-4774-a918-986cec9401bb None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:13.557137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 602/1201] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:54:13.563867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ba7c-f11d-4be7-a203-c03bd48d8129 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:13.564387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ba7c-f11d-4be7-a203-c03bd48d8129 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:13.564592 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ba7c-f11d-4be7-a203-c03bd48d8129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:13.586701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a1f9ba7c-f11d-4be7-a203-c03bd48d8129 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:13.587984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a1f9ba7c-f11d-4be7-a203-c03bd48d8129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:13.680198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 600/1202] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 16:54:13.998157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0ecb8-863a-4774-a918-986cec9401bb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:14.119158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0ecb8-863a-4774-a918-986cec9401bb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:14.165034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770869a0-ed21-4a81-b6d8-6421a1e1ce93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:14.166311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770869a0-ed21-4a81-b6d8-6421a1e1ce93 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:14.166311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770869a0-ed21-4a81-b6d8-6421a1e1ce93 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:14.166311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770869a0-ed21-4a81-b6d8-6421a1e1ce93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:14.181149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770869a0-ed21-4a81-b6d8-6421a1e1ce93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:14.182689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770869a0-ed21-4a81-b6d8-6421a1e1ce93 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-770869a0-ed21-4a81-b6d8-6421a1e1ce93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:14.209007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:14.210299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:14.211528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:14.211528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:14.211528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:14.213590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 603/1203] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:14.220451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ba7c-f11d-4be7-a203-c03bd48d8129 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:14.353162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ba7c-f11d-4be7-a203-c03bd48d8129 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:14.388385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:14.395434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22669f62-595e-4af1-8f7f-0ed3281fd660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:14.396065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22669f62-595e-4af1-8f7f-0ed3281fd660 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:14.396351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22669f62-595e-4af1-8f7f-0ed3281fd660 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:14.396654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22669f62-595e-4af1-8f7f-0ed3281fd660 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:14.397311 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22669f62-595e-4af1-8f7f-0ed3281fd660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:14.397619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22669f62-595e-4af1-8f7f-0ed3281fd660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:14.398997 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22669f62-595e-4af1-8f7f-0ed3281fd660 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:14.414073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 601/1204] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:14.421000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770869a0-ed21-4a81-b6d8-6421a1e1ce93 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:14.491154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:14.551561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770869a0-ed21-4a81-b6d8-6421a1e1ce93 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:14.597305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef9e3f-e652-4232-92f6-f95d84306e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:14.598176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9e3f-e652-4232-92f6-f95d84306e62 None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:14.598176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9e3f-e652-4232-92f6-f95d84306e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:14.598444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9e3f-e652-4232-92f6-f95d84306e62 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:14.599092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef9e3f-e652-4232-92f6-f95d84306e62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:14.600549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef9e3f-e652-4232-92f6-f95d84306e62 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:14.623643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 604/1205] 10.222.0.81 () {60 vars in 1132 bytes} [Thu Aug 18 16:54:14 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 16:54:17.003451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6170c-16a0-4a07-ac82-905c1f596714 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:17.003985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6170c-16a0-4a07-ac82-905c1f596714 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:17.003985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6170c-16a0-4a07-ac82-905c1f596714 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:17.005488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 602/1206] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:54:17.015921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44b1fc-2e88-4653-8b73-92a7ac9c97af None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:17.016434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44b1fc-2e88-4653-8b73-92a7ac9c97af None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:17.016561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44b1fc-2e88-4653-8b73-92a7ac9c97af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:17.036071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0e44b1fc-2e88-4653-8b73-92a7ac9c97af None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:17.037357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0e44b1fc-2e88-4653-8b73-92a7ac9c97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:17.116501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 605/1207] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:54:17.423996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6170c-16a0-4a07-ac82-905c1f596714 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:17.548516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6170c-16a0-4a07-ac82-905c1f596714 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:17.592813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aefb3a-4cea-4dcd-ab5d-2fa0bc9a0353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:17.593483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aefb3a-4cea-4dcd-ab5d-2fa0bc9a0353 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:17.593741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aefb3a-4cea-4dcd-ab5d-2fa0bc9a0353 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:17.594012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aefb3a-4cea-4dcd-ab5d-2fa0bc9a0353 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:17.605780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aefb3a-4cea-4dcd-ab5d-2fa0bc9a0353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a0aefb3a-4cea-4dcd-ab5d-2fa0bc9a0353 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:54:17.610789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:17.611830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:17.612877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 603/1208] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:54:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:54:17.618850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44b1fc-2e88-4653-8b73-92a7ac9c97af None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:17.662868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:17.732943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44b1fc-2e88-4653-8b73-92a7ac9c97af None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:17.772952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4f3cf-12b9-4c82-ae3f-ca7ad4ee41b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:17.773663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4f3cf-12b9-4c82-ae3f-ca7ad4ee41b4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:17.773887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4f3cf-12b9-4c82-ae3f-ca7ad4ee41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:17.774151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4f3cf-12b9-4c82-ae3f-ca7ad4ee41b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:17.774880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4f3cf-12b9-4c82-ae3f-ca7ad4ee41b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:17.775248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4f3cf-12b9-4c82-ae3f-ca7ad4ee41b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:17.776606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4f3cf-12b9-4c82-ae3f-ca7ad4ee41b4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:17.791407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 606/1209] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:54:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:54:17.793367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aefb3a-4cea-4dcd-ab5d-2fa0bc9a0353 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:17.855195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:17.926903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aefb3a-4cea-4dcd-ab5d-2fa0bc9a0353 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:17.970702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265270d5-f1f2-4811-a619-2165eb73e6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:17.971343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265270d5-f1f2-4811-a619-2165eb73e6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:17.971628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265270d5-f1f2-4811-a619-2165eb73e6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:17.971904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265270d5-f1f2-4811-a619-2165eb73e6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:17.987292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265270d5-f1f2-4811-a619-2165eb73e6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:17.989653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265270d5-f1f2-4811-a619-2165eb73e6a0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-265270d5-f1f2-4811-a619-2165eb73e6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:18.014715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:18.016407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:18.017718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:18.017718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:18.017718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:18.017718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 604/1210] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:18.022735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4f3cf-12b9-4c82-ae3f-ca7ad4ee41b4 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:18.146223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:18.150321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4f3cf-12b9-4c82-ae3f-ca7ad4ee41b4 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:18.195115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f14b1-5186-4b1d-b617-3e9b87c8b04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:18.195916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f14b1-5186-4b1d-b617-3e9b87c8b04f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:18.196232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f14b1-5186-4b1d-b617-3e9b87c8b04f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:18.196594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f14b1-5186-4b1d-b617-3e9b87c8b04f None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:18.197264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f14b1-5186-4b1d-b617-3e9b87c8b04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:18.197639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f14b1-5186-4b1d-b617-3e9b87c8b04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:18.199002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f14b1-5186-4b1d-b617-3e9b87c8b04f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:18.211361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 607/1211] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:54:18.218788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265270d5-f1f2-4811-a619-2165eb73e6a0 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:18.335957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265270d5-f1f2-4811-a619-2165eb73e6a0 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:18.338391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:18.386674 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e0ea1-3cdb-4532-899d-0ebd9155c422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:18.387349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e0ea1-3cdb-4532-899d-0ebd9155c422 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:18.387635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e0ea1-3cdb-4532-899d-0ebd9155c422 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:18.387912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e0ea1-3cdb-4532-899d-0ebd9155c422 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:18.398006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e0ea1-3cdb-4532-899d-0ebd9155c422 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:18.400135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e0ea1-3cdb-4532-899d-0ebd9155c422 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-6f5e0ea1-3cdb-4532-899d-0ebd9155c422 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:54:18.416846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:18.418245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:18.419303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 605/1212] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:18.424125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f14b1-5186-4b1d-b617-3e9b87c8b04f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:18.552068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f14b1-5186-4b1d-b617-3e9b87c8b04f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:18.597950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402f70-38ee-420e-816c-8c0e1ab885dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:18.598867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402f70-38ee-420e-816c-8c0e1ab885dd None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:18.598867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402f70-38ee-420e-816c-8c0e1ab885dd None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:18.599125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402f70-38ee-420e-816c-8c0e1ab885dd None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:18.599874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f402f70-38ee-420e-816c-8c0e1ab885dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:18.600183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f402f70-38ee-420e-816c-8c0e1ab885dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:18.602023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f402f70-38ee-420e-816c-8c0e1ab885dd None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:18.628494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 608/1213] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Aug 18 16:54:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:18.630555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e0ea1-3cdb-4532-899d-0ebd9155c422 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:18.753740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e0ea1-3cdb-4532-899d-0ebd9155c422 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:18.804602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfd4b1-f688-4c76-b102-6cd725d35dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:18.805402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfd4b1-f688-4c76-b102-6cd725d35dea None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:18.805838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfd4b1-f688-4c76-b102-6cd725d35dea None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:18.806732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfd4b1-f688-4c76-b102-6cd725d35dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:18.842468 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:18.898718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfd4b1-f688-4c76-b102-6cd725d35dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:18.900205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfd4b1-f688-4c76-b102-6cd725d35dea None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:19.045495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 606/1214] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:54:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:54:19.048487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402f70-38ee-420e-816c-8c0e1ab885dd None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:19.070145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:19.161715 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402f70-38ee-420e-816c-8c0e1ab885dd None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:19.199225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc6e5f-c67a-4e3c-942b-57e8c183042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:19.199974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc6e5f-c67a-4e3c-942b-57e8c183042b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:19.200323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc6e5f-c67a-4e3c-942b-57e8c183042b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:19.200689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc6e5f-c67a-4e3c-942b-57e8c183042b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:19.211322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc6e5f-c67a-4e3c-942b-57e8c183042b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:19.212941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc6e5f-c67a-4e3c-942b-57e8c183042b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-0edc6e5f-c67a-4e3c-942b-57e8c183042b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:19.227888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:19.229154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:19.230289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:19.230289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:19.230289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:19.235738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 609/1215] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:19.236959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfd4b1-f688-4c76-b102-6cd725d35dea None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:19.303462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:19.346603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfd4b1-f688-4c76-b102-6cd725d35dea None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:19.385213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522f734-8158-4479-91d9-11a65fcc0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:19.386010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522f734-8158-4479-91d9-11a65fcc0896 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:19.386372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522f734-8158-4479-91d9-11a65fcc0896 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:19.386743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522f734-8158-4479-91d9-11a65fcc0896 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:19.387438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522f734-8158-4479-91d9-11a65fcc0896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:19.387753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522f734-8158-4479-91d9-11a65fcc0896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:19.389183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522f734-8158-4479-91d9-11a65fcc0896 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:19.405692 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 607/1216] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:19.411429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc6e5f-c67a-4e3c-942b-57e8c183042b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:19.486704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:19.519646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc6e5f-c67a-4e3c-942b-57e8c183042b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:19.554992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa47383-021c-4986-a3e1-d8fcee00002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:19.555623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa47383-021c-4986-a3e1-d8fcee00002e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:19.555953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa47383-021c-4986-a3e1-d8fcee00002e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:19.556226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa47383-021c-4986-a3e1-d8fcee00002e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:19.563835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa47383-021c-4986-a3e1-d8fcee00002e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:19.565342 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa47383-021c-4986-a3e1-d8fcee00002e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-aaa47383-021c-4986-a3e1-d8fcee00002e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:54:19.577359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:19.578403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:19.579345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:54:19.579345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:54:19.579345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:54:19.579345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:54:19.579345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:54:19.579345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:54:19.579345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:19.579345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:19.584486 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 610/1217] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:54:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:19.584657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522f734-8158-4479-91d9-11a65fcc0896 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:19.699877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522f734-8158-4479-91d9-11a65fcc0896 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:19.732707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:19.756851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db96fa9-5393-4810-b87b-176267b04ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:19.757726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96fa9-5393-4810-b87b-176267b04ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:19.758118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96fa9-5393-4810-b87b-176267b04ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:19.758506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96fa9-5393-4810-b87b-176267b04ee0 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:19.759456 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96fa9-5393-4810-b87b-176267b04ee0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:19.759812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96fa9-5393-4810-b87b-176267b04ee0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:19.761660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96fa9-5393-4810-b87b-176267b04ee0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:19.777207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 608/1218] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:54:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:19.782677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa47383-021c-4986-a3e1-d8fcee00002e None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:19.907162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa47383-021c-4986-a3e1-d8fcee00002e None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:19.941218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:19.947172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac124da4-153b-4b27-b08a-84ded4f1326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:19.947905 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac124da4-153b-4b27-b08a-84ded4f1326e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:19.948513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac124da4-153b-4b27-b08a-84ded4f1326e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:19.949001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac124da4-153b-4b27-b08a-84ded4f1326e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:19.951711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac124da4-153b-4b27-b08a-84ded4f1326e None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=4cc1ad7e47454b5d9d2ef2190414010c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:19.952104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac124da4-153b-4b27-b08a-84ded4f1326e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:19.953774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac124da4-153b-4b27-b08a-84ded4f1326e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:19.960694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 611/1219] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:54:19 2022] GET /identity/v3/role_assignments?user.id=4cc1ad7e47454b5d9d2ef2190414010c&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:22.034449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f247b7-a32e-4161-a4e5-00020d7510de None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:22.035004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f247b7-a32e-4161-a4e5-00020d7510de None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:22.035004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f247b7-a32e-4161-a4e5-00020d7510de None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:22.036658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 609/1220] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:54:22.045731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f84fc-feca-4749-b668-e6c18d4eb38b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:22.046271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f84fc-feca-4749-b668-e6c18d4eb38b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:22.046615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f84fc-feca-4749-b668-e6c18d4eb38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:22.074521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-209f84fc-feca-4749-b668-e6c18d4eb38b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:22.075757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-209f84fc-feca-4749-b668-e6c18d4eb38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:22.160240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 612/1221] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:54:22.495393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f247b7-a32e-4161-a4e5-00020d7510de None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:22.620948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f247b7-a32e-4161-a4e5-00020d7510de None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:22.660087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5ae88-4c91-4c53-86ed-ad541cb0ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:22.660848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5ae88-4c91-4c53-86ed-ad541cb0ac19 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:22.661184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5ae88-4c91-4c53-86ed-ad541cb0ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:22.661478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5ae88-4c91-4c53-86ed-ad541cb0ac19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:22.675129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5ae88-4c91-4c53-86ed-ad541cb0ac19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-a9f5ae88-4c91-4c53-86ed-ad541cb0ac19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:54:22.681410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:22.682490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:22.684143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 610/1222] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:54:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:22.689247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f84fc-feca-4749-b668-e6c18d4eb38b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:22.825373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f84fc-feca-4749-b668-e6c18d4eb38b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:22.852182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:22.864479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb80b3-6f18-4773-a3ea-e4c6cedfdc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:22.865100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb80b3-6f18-4773-a3ea-e4c6cedfdc4d None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:22.865375 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb80b3-6f18-4773-a3ea-e4c6cedfdc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:22.865645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb80b3-6f18-4773-a3ea-e4c6cedfdc4d None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:22.866306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb80b3-6f18-4773-a3ea-e4c6cedfdc4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:22.866607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb80b3-6f18-4773-a3ea-e4c6cedfdc4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:22.868681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb80b3-6f18-4773-a3ea-e4c6cedfdc4d None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:22.878018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 613/1223] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:54:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:22.885148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5ae88-4c91-4c53-86ed-ad541cb0ac19 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:22.933965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:23.000523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5ae88-4c91-4c53-86ed-ad541cb0ac19 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:23.037912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85514b-88f4-45cd-84fe-e9037de8f1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:23.038829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85514b-88f4-45cd-84fe-e9037de8f1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:23.039130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85514b-88f4-45cd-84fe-e9037de8f1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:23.039425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85514b-88f4-45cd-84fe-e9037de8f1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:23.051171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85514b-88f4-45cd-84fe-e9037de8f1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:23.052680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85514b-88f4-45cd-84fe-e9037de8f1a8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8a85514b-88f4-45cd-84fe-e9037de8f1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:23.072182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:23.078455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:23.079457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:23.079457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:23.079457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:23.079457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 611/1224] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:23.079866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb80b3-6f18-4773-a3ea-e4c6cedfdc4d None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:23.191474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb80b3-6f18-4773-a3ea-e4c6cedfdc4d None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:23.232065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0617c7-e3fa-45be-b7cd-d3ce5b6b18ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:23.232742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0617c7-e3fa-45be-b7cd-d3ce5b6b18ba None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:23.233023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0617c7-e3fa-45be-b7cd-d3ce5b6b18ba None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:23.233331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0617c7-e3fa-45be-b7cd-d3ce5b6b18ba None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:23.234021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0617c7-e3fa-45be-b7cd-d3ce5b6b18ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:23.234629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0617c7-e3fa-45be-b7cd-d3ce5b6b18ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:23.236090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0617c7-e3fa-45be-b7cd-d3ce5b6b18ba None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:23.249460 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 614/1225] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:23.255960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85514b-88f4-45cd-84fe-e9037de8f1a8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:23.358003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:23.368969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85514b-88f4-45cd-84fe-e9037de8f1a8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:23.409509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bfff5-f1e9-4966-b280-81b8c49d6001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:23.410313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfff5-f1e9-4966-b280-81b8c49d6001 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:23.410635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfff5-f1e9-4966-b280-81b8c49d6001 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:23.411063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfff5-f1e9-4966-b280-81b8c49d6001 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:23.419820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bfff5-f1e9-4966-b280-81b8c49d6001 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:23.421798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bfff5-f1e9-4966-b280-81b8c49d6001 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-b49bfff5-f1e9-4966-b280-81b8c49d6001 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:54:23.436440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:23.437705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:23.438896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 612/1226] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:23.444204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0617c7-e3fa-45be-b7cd-d3ce5b6b18ba None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:23.502122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:23.571796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0617c7-e3fa-45be-b7cd-d3ce5b6b18ba None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:23.612528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa77109-8521-43ec-9e64-8cfff7121430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:23.613383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa77109-8521-43ec-9e64-8cfff7121430 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:23.613748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa77109-8521-43ec-9e64-8cfff7121430 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:23.614129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa77109-8521-43ec-9e64-8cfff7121430 None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:23.615337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa77109-8521-43ec-9e64-8cfff7121430 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:23.615926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa77109-8521-43ec-9e64-8cfff7121430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:23.618846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa77109-8521-43ec-9e64-8cfff7121430 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:23.639436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 615/1227] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Aug 18 16:54:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:23.646282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bfff5-f1e9-4966-b280-81b8c49d6001 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:23.765171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bfff5-f1e9-4966-b280-81b8c49d6001 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:23.804858 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef42cd4-93b3-4097-b9e4-3ad572eb2703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:23.805685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef42cd4-93b3-4097-b9e4-3ad572eb2703 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:23.806512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef42cd4-93b3-4097-b9e4-3ad572eb2703 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:23.806828 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef42cd4-93b3-4097-b9e4-3ad572eb2703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:23.819317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef42cd4-93b3-4097-b9e4-3ad572eb2703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:23.820867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef42cd4-93b3-4097-b9e4-3ad572eb2703 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5ef42cd4-93b3-4097-b9e4-3ad572eb2703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:23.836117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:23.837280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:23.838207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:23.838207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:23.838207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:23.838207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 613/1228] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:23.843672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa77109-8521-43ec-9e64-8cfff7121430 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:23.958835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa77109-8521-43ec-9e64-8cfff7121430 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:23.961201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:24.001658 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf4e6a-9bf1-4d0e-8955-dae51109489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:24.002565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf4e6a-9bf1-4d0e-8955-dae51109489f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:24.002767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf4e6a-9bf1-4d0e-8955-dae51109489f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:24.003171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf4e6a-9bf1-4d0e-8955-dae51109489f None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:24.004048 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf4e6a-9bf1-4d0e-8955-dae51109489f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:24.004521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf4e6a-9bf1-4d0e-8955-dae51109489f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:24.006451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf4e6a-9bf1-4d0e-8955-dae51109489f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:24.022389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 616/1229] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:24.028289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef42cd4-93b3-4097-b9e4-3ad572eb2703 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:24.038429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:24.141911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef42cd4-93b3-4097-b9e4-3ad572eb2703 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:24.184135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81d61c-c9c1-4025-8b1d-9a2edf048e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:24.184809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d61c-c9c1-4025-8b1d-9a2edf048e4e None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:24.185089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d61c-c9c1-4025-8b1d-9a2edf048e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:24.185365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d61c-c9c1-4025-8b1d-9a2edf048e4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:24.192877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81d61c-c9c1-4025-8b1d-9a2edf048e4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:24.194390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81d61c-c9c1-4025-8b1d-9a2edf048e4e None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8f81d61c-c9c1-4025-8b1d-9a2edf048e4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:54:24.206326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:24.207502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:24.208557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:54:24.208557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:54:24.208557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:54:24.208557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:54:24.208557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:54:24.208557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:54:24.208557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:24.208557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:24.208557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 614/1230] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:54:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:24.214884 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf4e6a-9bf1-4d0e-8955-dae51109489f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:24.337703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf4e6a-9bf1-4d0e-8955-dae51109489f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:24.374628 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab2e3c-ebcd-4f0e-aac9-8a5c0841b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:24.375244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab2e3c-ebcd-4f0e-aac9-8a5c0841b8ec None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:24.375526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab2e3c-ebcd-4f0e-aac9-8a5c0841b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:24.375821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab2e3c-ebcd-4f0e-aac9-8a5c0841b8ec None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:24.376558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab2e3c-ebcd-4f0e-aac9-8a5c0841b8ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:24.376867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab2e3c-ebcd-4f0e-aac9-8a5c0841b8ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:24.378302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab2e3c-ebcd-4f0e-aac9-8a5c0841b8ec None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:24.390663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 617/1231] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:54:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:24.396882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81d61c-c9c1-4025-8b1d-9a2edf048e4e None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:24.470722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:24.507127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81d61c-c9c1-4025-8b1d-9a2edf048e4e None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:24.542632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523629f-96de-4f54-8faa-a5dcd239db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:24.543387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523629f-96de-4f54-8faa-a5dcd239db05 None admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:24.543691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523629f-96de-4f54-8faa-a5dcd239db05 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:24.543964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523629f-96de-4f54-8faa-a5dcd239db05 None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/4cc1ad7e47454b5d9d2ef2190414010c/roles/b5bf9002fca54b179a5f07114e18fa07` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:24.558677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523629f-96de-4f54-8faa-a5dcd239db05 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=4cc1ad7e47454b5d9d2ef2190414010c, role_id=b5bf9002fca54b179a5f07114e18fa07)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:24.560110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523629f-96de-4f54-8faa-a5dcd239db05 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:24.573732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 615/1232] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:54:24 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/4cc1ad7e47454b5d9d2ef2190414010c/roles/b5bf9002fca54b179a5f07114e18fa07 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:54:26.744960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358f7e2-d494-460c-a7f7-b8c6c6566bee None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:26.745418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358f7e2-d494-460c-a7f7-b8c6c6566bee None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:26.745775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358f7e2-d494-460c-a7f7-b8c6c6566bee None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:26.747139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 618/1233] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:54:26.752853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e03743-8e5e-460b-89a5-927fdce25f4f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:26.753414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e03743-8e5e-460b-89a5-927fdce25f4f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:26.753414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e03743-8e5e-460b-89a5-927fdce25f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:26.773341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b4e03743-8e5e-460b-89a5-927fdce25f4f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:26.774700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b4e03743-8e5e-460b-89a5-927fdce25f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:26.851141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 616/1234] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:54:27.145131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358f7e2-d494-460c-a7f7-b8c6c6566bee None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:27.172940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:27.259708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358f7e2-d494-460c-a7f7-b8c6c6566bee None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:27.314010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554df74-1652-4feb-8555-a92b65bd9601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:27.314743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554df74-1652-4feb-8555-a92b65bd9601 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:27.315026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554df74-1652-4feb-8555-a92b65bd9601 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:27.315395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554df74-1652-4feb-8555-a92b65bd9601 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:27.326363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554df74-1652-4feb-8555-a92b65bd9601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b554df74-1652-4feb-8555-a92b65bd9601 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:54:27.331549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:27.332736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:27.333742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 619/1235] 10.222.0.81 () {56 vars in 1102 bytes} [Thu Aug 18 16:54:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:27.339905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e03743-8e5e-460b-89a5-927fdce25f4f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:27.393462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:27.460223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e03743-8e5e-460b-89a5-927fdce25f4f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:27.499340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e851dd-3ff3-4ade-b58b-2cb70646f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:27.499970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e851dd-3ff3-4ade-b58b-2cb70646f176 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:27.500257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e851dd-3ff3-4ade-b58b-2cb70646f176 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:27.500564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e851dd-3ff3-4ade-b58b-2cb70646f176 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:27.501243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e851dd-3ff3-4ade-b58b-2cb70646f176 None admin] RBAC: Adding query filter params (name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:27.501553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e851dd-3ff3-4ade-b58b-2cb70646f176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:27.502925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e851dd-3ff3-4ade-b58b-2cb70646f176 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:27.512801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 617/1236] 10.222.0.81 () {56 vars in 1103 bytes} [Thu Aug 18 16:54:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:27.518798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554df74-1652-4feb-8555-a92b65bd9601 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:27.630607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:27.653034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554df74-1652-4feb-8555-a92b65bd9601 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:27.695637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0c166-f015-4548-8db5-616ed700b566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:27.696977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0c166-f015-4548-8db5-616ed700b566 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:27.697350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0c166-f015-4548-8db5-616ed700b566 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:27.697634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0c166-f015-4548-8db5-616ed700b566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:27.710013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0c166-f015-4548-8db5-616ed700b566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:27.711545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0c166-f015-4548-8db5-616ed700b566 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-4fd0c166-f015-4548-8db5-616ed700b566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:27.729118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:27.736398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:27.737404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:27.737404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:27.737404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:27.737404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 620/1237] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:54:27.737909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e851dd-3ff3-4ade-b58b-2cb70646f176 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:27.853144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e851dd-3ff3-4ade-b58b-2cb70646f176 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:27.863675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:27.897279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad8f1c-7268-488c-a6bd-f27248c2b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:27.898070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8f1c-7268-488c-a6bd-f27248c2b960 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:27.898406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8f1c-7268-488c-a6bd-f27248c2b960 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:27.898684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8f1c-7268-488c-a6bd-f27248c2b960 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:27.900053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad8f1c-7268-488c-a6bd-f27248c2b960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:27.900367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad8f1c-7268-488c-a6bd-f27248c2b960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:27.902099 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad8f1c-7268-488c-a6bd-f27248c2b960 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:27.916126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 618/1238] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:27.922549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0c166-f015-4548-8db5-616ed700b566 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:28.049777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0c166-f015-4548-8db5-616ed700b566 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:28.091218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a4311-e2ea-4756-aed5-e56f352cc706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:28.091930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4311-e2ea-4756-aed5-e56f352cc706 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:28.092243 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4311-e2ea-4756-aed5-e56f352cc706 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:28.092585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4311-e2ea-4756-aed5-e56f352cc706 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:28.095799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:28.102728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a4311-e2ea-4756-aed5-e56f352cc706 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:28.104768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a4311-e2ea-4756-aed5-e56f352cc706 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8a7a4311-e2ea-4756-aed5-e56f352cc706 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:54:28.119549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:28.120849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:28.122019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:28.122019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:28.122019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:54:28.122019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:54:28.122019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:54:28.122019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:54:28.122019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:54:28.122019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:54:28.122019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:28.122019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:28.125783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 621/1239] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:28.126840 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad8f1c-7268-488c-a6bd-f27248c2b960 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:28.238895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad8f1c-7268-488c-a6bd-f27248c2b960 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:28.273772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943558-bdcb-448f-b6f2-5633a1226e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:28.274983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943558-bdcb-448f-b6f2-5633a1226e33 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:28.275211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943558-bdcb-448f-b6f2-5633a1226e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:28.275590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943558-bdcb-448f-b6f2-5633a1226e33 None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:28.276363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e943558-bdcb-448f-b6f2-5633a1226e33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:28.276822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e943558-bdcb-448f-b6f2-5633a1226e33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:28.278439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e943558-bdcb-448f-b6f2-5633a1226e33 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:28.299604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 619/1240] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Aug 18 16:54:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:54:28.306712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a4311-e2ea-4756-aed5-e56f352cc706 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:28.428228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a4311-e2ea-4756-aed5-e56f352cc706 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:28.471149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58a263-b2a5-4cd6-a945-5c968059ca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:28.472206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58a263-b2a5-4cd6-a945-5c968059ca47 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:28.472712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58a263-b2a5-4cd6-a945-5c968059ca47 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:28.473159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58a263-b2a5-4cd6-a945-5c968059ca47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:28.545603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:28.554214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58a263-b2a5-4cd6-a945-5c968059ca47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:28.555909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58a263-b2a5-4cd6-a945-5c968059ca47 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:28.677177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 622/1241] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:54:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:54:28.683913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943558-bdcb-448f-b6f2-5633a1226e33 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:28.716760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:28.801904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943558-bdcb-448f-b6f2-5633a1226e33 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:28.847356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6d1b-a4b4-48b2-9888-a06c751789ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:28.847993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6d1b-a4b4-48b2-9888-a06c751789ef None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:28.848275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6d1b-a4b4-48b2-9888-a06c751789ef None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:28.848580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6d1b-a4b4-48b2-9888-a06c751789ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:28.860508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6d1b-a4b4-48b2-9888-a06c751789ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:28.862428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6d1b-a4b4-48b2-9888-a06c751789ef None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-8bfa6d1b-a4b4-48b2-9888-a06c751789ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:28.880523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:28.881809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:28.882985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:28.882985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:28.882985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:28.882985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 620/1242] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:28.888856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58a263-b2a5-4cd6-a945-5c968059ca47 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:29.000421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:29.008113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58a263-b2a5-4cd6-a945-5c968059ca47 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:29.058220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881829fc-c3b0-4f5b-83d7-fa177e7e0210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:29.058836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881829fc-c3b0-4f5b-83d7-fa177e7e0210 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:29.059114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881829fc-c3b0-4f5b-83d7-fa177e7e0210 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:29.059386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881829fc-c3b0-4f5b-83d7-fa177e7e0210 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:29.060080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881829fc-c3b0-4f5b-83d7-fa177e7e0210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:29.060380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881829fc-c3b0-4f5b-83d7-fa177e7e0210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:29.061876 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881829fc-c3b0-4f5b-83d7-fa177e7e0210 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:29.081753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 623/1243] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:54:29.082989 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6d1b-a4b4-48b2-9888-a06c751789ef None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:29.195825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:29.221093 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6d1b-a4b4-48b2-9888-a06c751789ef None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:29.256103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496b240-04c8-4f85-a09d-e4e6a8e5cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:29.256778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496b240-04c8-4f85-a09d-e4e6a8e5cb9d None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:29.257055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496b240-04c8-4f85-a09d-e4e6a8e5cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:29.257334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496b240-04c8-4f85-a09d-e4e6a8e5cb9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:29.267465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496b240-04c8-4f85-a09d-e4e6a8e5cb9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:29.270063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496b240-04c8-4f85-a09d-e4e6a8e5cb9d None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-5496b240-04c8-4f85-a09d-e4e6a8e5cb9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:54:29.288842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:29.290019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:29.296208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:54:29.296208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:54:29.296208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:54:29.296208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:54:29.296208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:54:29.296208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:54:29.296208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:29.296208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:29.296208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 621/1244] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:54:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:29.296995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881829fc-c3b0-4f5b-83d7-fa177e7e0210 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:29.413583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881829fc-c3b0-4f5b-83d7-fa177e7e0210 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:29.452342 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe691393-2170-4b9f-8d3a-a8764487c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:29.453196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe691393-2170-4b9f-8d3a-a8764487c591 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:29.453421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe691393-2170-4b9f-8d3a-a8764487c591 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:29.453827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe691393-2170-4b9f-8d3a-a8764487c591 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:29.454593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe691393-2170-4b9f-8d3a-a8764487c591 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:29.454898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe691393-2170-4b9f-8d3a-a8764487c591 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:29.456336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe691393-2170-4b9f-8d3a-a8764487c591 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:29.471539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 624/1245] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:54:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:29.478015 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496b240-04c8-4f85-a09d-e4e6a8e5cb9d None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:29.593404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496b240-04c8-4f85-a09d-e4e6a8e5cb9d None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:29.631454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02483ccd-1dc9-4282-978c-3f4ff4252851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:29.632168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483ccd-1dc9-4282-978c-3f4ff4252851 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:29.632481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483ccd-1dc9-4282-978c-3f4ff4252851 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:29.632783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483ccd-1dc9-4282-978c-3f4ff4252851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:29.634119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483ccd-1dc9-4282-978c-3f4ff4252851 None admin] RBAC: Adding query filter params (role.id=b5bf9002fca54b179a5f07114e18fa07, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=4cc1ad7e47454b5d9d2ef2190414010c) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:29.634434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483ccd-1dc9-4282-978c-3f4ff4252851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:29.636017 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483ccd-1dc9-4282-978c-3f4ff4252851 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:29.642912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 622/1246] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:54:29 2022] GET /identity/v3/role_assignments?user.id=4cc1ad7e47454b5d9d2ef2190414010c&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=b5bf9002fca54b179a5f07114e18fa07 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:31.809533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9d342-6800-46fe-9c25-016ea9c596f6 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:31.810324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9d342-6800-46fe-9c25-016ea9c596f6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:31.810489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9d342-6800-46fe-9c25-016ea9c596f6 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:31.812169 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 625/1247] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:54:31.818612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372606b5-41e5-4203-b1d6-da5f0dd63dbb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:31.819138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372606b5-41e5-4203-b1d6-da5f0dd63dbb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:31.819247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372606b5-41e5-4203-b1d6-da5f0dd63dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:31.826710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:31.839690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-372606b5-41e5-4203-b1d6-da5f0dd63dbb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:31.840940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-372606b5-41e5-4203-b1d6-da5f0dd63dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:31.935124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 623/1248] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:54:32.246518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9d342-6800-46fe-9c25-016ea9c596f6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:32.269844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:32.378970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9d342-6800-46fe-9c25-016ea9c596f6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:32.426498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d41bb-826b-45d1-8bee-1cfc7ea685c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:32.427254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d41bb-826b-45d1-8bee-1cfc7ea685c0 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:32.427538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d41bb-826b-45d1-8bee-1cfc7ea685c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:32.427852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d41bb-826b-45d1-8bee-1cfc7ea685c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:32.444751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d41bb-826b-45d1-8bee-1cfc7ea685c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-731d41bb-826b-45d1-8bee-1cfc7ea685c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:54:32.450455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:32.452588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:32.453849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 626/1249] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:54:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:54:32.458565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372606b5-41e5-4203-b1d6-da5f0dd63dbb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:32.581409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372606b5-41e5-4203-b1d6-da5f0dd63dbb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:32.628256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:32.635949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bf946-eaba-44fd-a520-0ac944eb32c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:32.636623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf946-eaba-44fd-a520-0ac944eb32c5 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:32.636953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf946-eaba-44fd-a520-0ac944eb32c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:32.637245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bf946-eaba-44fd-a520-0ac944eb32c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:32.637953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bf946-eaba-44fd-a520-0ac944eb32c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:32.638231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bf946-eaba-44fd-a520-0ac944eb32c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:32.639673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bf946-eaba-44fd-a520-0ac944eb32c5 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:32.649901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 624/1250] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:54:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:32.656554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d41bb-826b-45d1-8bee-1cfc7ea685c0 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:32.764229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:32.792317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d41bb-826b-45d1-8bee-1cfc7ea685c0 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:32.837822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346ae80-5c69-474f-b4d0-d0e0fa842783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:32.838599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346ae80-5c69-474f-b4d0-d0e0fa842783 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:32.838719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346ae80-5c69-474f-b4d0-d0e0fa842783 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:32.838901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346ae80-5c69-474f-b4d0-d0e0fa842783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:32.850572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346ae80-5c69-474f-b4d0-d0e0fa842783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:32.852230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346ae80-5c69-474f-b4d0-d0e0fa842783 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-8346ae80-5c69-474f-b4d0-d0e0fa842783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:32.869405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:32.870647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:32.871737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:32.871737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:32.871737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:32.871737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 627/1251] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:32.876817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bf946-eaba-44fd-a520-0ac944eb32c5 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:32.999448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bf946-eaba-44fd-a520-0ac944eb32c5 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:33.050572 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6892c-d472-4c94-bc34-e58c68041271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:33.051270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6892c-d472-4c94-bc34-e58c68041271 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:33.051611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6892c-d472-4c94-bc34-e58c68041271 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:33.051948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6892c-d472-4c94-bc34-e58c68041271 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:33.052702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6892c-d472-4c94-bc34-e58c68041271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:33.053038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6892c-d472-4c94-bc34-e58c68041271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:33.054568 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6892c-d472-4c94-bc34-e58c68041271 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:33.070061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 625/1252] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:33.076482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346ae80-5c69-474f-b4d0-d0e0fa842783 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:33.181922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346ae80-5c69-474f-b4d0-d0e0fa842783 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:33.209733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:33.218030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f1459-8246-414c-9c26-cda6cfd314f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:33.218671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f1459-8246-414c-9c26-cda6cfd314f3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:33.218975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f1459-8246-414c-9c26-cda6cfd314f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:33.219241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f1459-8246-414c-9c26-cda6cfd314f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:33.226959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f1459-8246-414c-9c26-cda6cfd314f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:33.228416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f1459-8246-414c-9c26-cda6cfd314f3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-471f1459-8246-414c-9c26-cda6cfd314f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:54:33.239945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:33.241223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:33.242424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:33.242424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:33.242424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:54:33.242424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:54:33.242424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:54:33.242424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:54:33.242424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:54:33.242424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:54:33.242424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:33.242424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:33.246553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 628/1253] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:54:33.247736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6892c-d472-4c94-bc34-e58c68041271 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:33.310819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:33.361445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6892c-d472-4c94-bc34-e58c68041271 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:33.403549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26465d-de33-4e5a-8207-792898ac6ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:33.404225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26465d-de33-4e5a-8207-792898ac6ccf None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:33.404597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26465d-de33-4e5a-8207-792898ac6ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:33.404884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26465d-de33-4e5a-8207-792898ac6ccf None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:33.405659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26465d-de33-4e5a-8207-792898ac6ccf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:33.406022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26465d-de33-4e5a-8207-792898ac6ccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:33.407451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26465d-de33-4e5a-8207-792898ac6ccf None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:33.430131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 626/1254] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Aug 18 16:54:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:33.436208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f1459-8246-414c-9c26-cda6cfd314f3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:33.543545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f1459-8246-414c-9c26-cda6cfd314f3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:33.579038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baf420-c92f-48df-bc8f-d6ffad58fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:33.579653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baf420-c92f-48df-bc8f-d6ffad58fc93 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:33.579939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baf420-c92f-48df-bc8f-d6ffad58fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:33.580217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baf420-c92f-48df-bc8f-d6ffad58fc93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:33.637678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:33.650652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baf420-c92f-48df-bc8f-d6ffad58fc93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:33.652107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86baf420-c92f-48df-bc8f-d6ffad58fc93 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:33.764775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 629/1255] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:54:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 16:54:33.771014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26465d-de33-4e5a-8207-792898ac6ccf None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:33.875476 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26465d-de33-4e5a-8207-792898ac6ccf None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:33.891176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:33.919306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a7543-3f92-448f-85fd-f48eca50cf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:33.919949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7543-3f92-448f-85fd-f48eca50cf31 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:33.920235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7543-3f92-448f-85fd-f48eca50cf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:33.920536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7543-3f92-448f-85fd-f48eca50cf31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:33.931476 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a7543-3f92-448f-85fd-f48eca50cf31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:33.932973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a7543-3f92-448f-85fd-f48eca50cf31 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-2f3a7543-3f92-448f-85fd-f48eca50cf31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:33.947536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:33.953206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:33.954164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:33.954164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:33.954164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:33.954164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 627/1256] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:33.954430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baf420-c92f-48df-bc8f-d6ffad58fc93 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:34.059610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:34.072861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86baf420-c92f-48df-bc8f-d6ffad58fc93 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:34.111249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f9f06-ae02-4ffd-bfa2-c300e3319b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:34.111875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9f06-ae02-4ffd-bfa2-c300e3319b0f None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:34.112235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9f06-ae02-4ffd-bfa2-c300e3319b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:34.112488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9f06-ae02-4ffd-bfa2-c300e3319b0f None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:34.113123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f9f06-ae02-4ffd-bfa2-c300e3319b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:34.113460 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f9f06-ae02-4ffd-bfa2-c300e3319b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:34.114821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f9f06-ae02-4ffd-bfa2-c300e3319b0f None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:34.126548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 630/1257] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:34.132610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a7543-3f92-448f-85fd-f48eca50cf31 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:34.239539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a7543-3f92-448f-85fd-f48eca50cf31 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:34.274423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0648e3-ee5c-473c-ae04-379a92922626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:34.275670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0648e3-ee5c-473c-ae04-379a92922626 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:34.275670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0648e3-ee5c-473c-ae04-379a92922626 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:34.275861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0648e3-ee5c-473c-ae04-379a92922626 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:34.282700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0648e3-ee5c-473c-ae04-379a92922626 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:34.284267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0648e3-ee5c-473c-ae04-379a92922626 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-da0648e3-ee5c-473c-ae04-379a92922626 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:54:34.297370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:34.298691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:34.299831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:54:34.299831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:54:34.299831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:54:34.299831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:54:34.299831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:54:34.299831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:54:34.299831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:34.299831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:34.299831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 628/1258] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:54:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 16:54:34.304784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f9f06-ae02-4ffd-bfa2-c300e3319b0f None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:34.415432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f9f06-ae02-4ffd-bfa2-c300e3319b0f None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:34.455528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87c473-7f66-4632-a955-91dce0949fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:34.456153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87c473-7f66-4632-a955-91dce0949fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:34.456438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87c473-7f66-4632-a955-91dce0949fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:34.456746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87c473-7f66-4632-a955-91dce0949fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:34.457444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87c473-7f66-4632-a955-91dce0949fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:34.457793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87c473-7f66-4632-a955-91dce0949fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:34.459319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87c473-7f66-4632-a955-91dce0949fd4 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:34.476244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 631/1259] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:54:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:34.482685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0648e3-ee5c-473c-ae04-379a92922626 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:34.512538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:34.600353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0648e3-ee5c-473c-ae04-379a92922626 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:34.643717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f4ffd-6014-49a9-8ad4-5d6df0c6e9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:34.644352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f4ffd-6014-49a9-8ad4-5d6df0c6e9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:34.644743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f4ffd-6014-49a9-8ad4-5d6df0c6e9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:34.644984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f4ffd-6014-49a9-8ad4-5d6df0c6e9e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:34.645806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f4ffd-6014-49a9-8ad4-5d6df0c6e9e0 None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=4cc1ad7e47454b5d9d2ef2190414010c) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:34.646162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f4ffd-6014-49a9-8ad4-5d6df0c6e9e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:34.647762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f4ffd-6014-49a9-8ad4-5d6df0c6e9e0 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:34.655135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 629/1260] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:54:34 2022] GET /identity/v3/role_assignments?user.id=4cc1ad7e47454b5d9d2ef2190414010c&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=56228137a4444ef9b7e688d04abd00fd => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:54:36.577593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f20647-61b6-4e0f-a29a-ba177ac7792e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:36.578162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f20647-61b6-4e0f-a29a-ba177ac7792e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:36.578162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f20647-61b6-4e0f-a29a-ba177ac7792e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:36.579474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 632/1261] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:54:36.584902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17500e6d-597f-4d7f-b5ad-7b0d75f11147 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:36.585291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17500e6d-597f-4d7f-b5ad-7b0d75f11147 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:36.585463 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17500e6d-597f-4d7f-b5ad-7b0d75f11147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:36.605053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-17500e6d-597f-4d7f-b5ad-7b0d75f11147 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:36.606255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-17500e6d-597f-4d7f-b5ad-7b0d75f11147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:36.672170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 630/1262] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:54:36.943355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f20647-61b6-4e0f-a29a-ba177ac7792e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:36.954669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:37.070733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f20647-61b6-4e0f-a29a-ba177ac7792e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:37.106514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028879c-748b-4235-8164-e7bed0665c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:37.107168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028879c-748b-4235-8164-e7bed0665c5a None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:37.107445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028879c-748b-4235-8164-e7bed0665c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:37.107718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028879c-748b-4235-8164-e7bed0665c5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:37.118034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028879c-748b-4235-8164-e7bed0665c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d028879c-748b-4235-8164-e7bed0665c5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:54:37.122765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:37.123945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:37.125296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 633/1263] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:54:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:37.129870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17500e6d-597f-4d7f-b5ad-7b0d75f11147 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:37.147610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:37.226624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17500e6d-597f-4d7f-b5ad-7b0d75f11147 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:37.263213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d170032-4abb-40c1-a53d-8db21e046ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:37.264031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d170032-4abb-40c1-a53d-8db21e046ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:37.264408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d170032-4abb-40c1-a53d-8db21e046ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:37.264838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d170032-4abb-40c1-a53d-8db21e046ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:37.265846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d170032-4abb-40c1-a53d-8db21e046ea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:37.266184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d170032-4abb-40c1-a53d-8db21e046ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:37.267538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d170032-4abb-40c1-a53d-8db21e046ea4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:37.277440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 631/1264] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:54:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:37.283194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028879c-748b-4235-8164-e7bed0665c5a None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:37.347889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:37.380155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028879c-748b-4235-8164-e7bed0665c5a None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:37.413501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dbe74-f573-48f9-a09b-54e6a875f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:37.414118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dbe74-f573-48f9-a09b-54e6a875f3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:37.414421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dbe74-f573-48f9-a09b-54e6a875f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:37.414694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dbe74-f573-48f9-a09b-54e6a875f3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:37.424658 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dbe74-f573-48f9-a09b-54e6a875f3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:37.426091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dbe74-f573-48f9-a09b-54e6a875f3e3 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-e51dbe74-f573-48f9-a09b-54e6a875f3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:37.440402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:37.441595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:37.442735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:37.442735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:37.442735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:37.442735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 634/1265] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:37.447950 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d170032-4abb-40c1-a53d-8db21e046ea4 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:37.528540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:37.549360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d170032-4abb-40c1-a53d-8db21e046ea4 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:37.583637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f656be1-ae3d-4931-adc3-ed63141da519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:37.584247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f656be1-ae3d-4931-adc3-ed63141da519 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:37.584564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f656be1-ae3d-4931-adc3-ed63141da519 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:37.584841 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f656be1-ae3d-4931-adc3-ed63141da519 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:37.585486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f656be1-ae3d-4931-adc3-ed63141da519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:37.586049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f656be1-ae3d-4931-adc3-ed63141da519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:37.587737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f656be1-ae3d-4931-adc3-ed63141da519 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:37.599195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 632/1266] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:37.604959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dbe74-f573-48f9-a09b-54e6a875f3e3 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:37.704017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dbe74-f573-48f9-a09b-54e6a875f3e3 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:37.725447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:37.739828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c8aa-d8d3-4029-bd9d-fff26f235577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:37.740483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c8aa-d8d3-4029-bd9d-fff26f235577 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:37.740760 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c8aa-d8d3-4029-bd9d-fff26f235577 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:37.741034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c8aa-d8d3-4029-bd9d-fff26f235577 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:37.748574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5c8aa-d8d3-4029-bd9d-fff26f235577 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:37.749998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5c8aa-d8d3-4029-bd9d-fff26f235577 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-2dd5c8aa-d8d3-4029-bd9d-fff26f235577 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:54:37.761644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:37.762794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:37.763975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 635/1267] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:37.768549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f656be1-ae3d-4931-adc3-ed63141da519 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:37.864116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f656be1-ae3d-4931-adc3-ed63141da519 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:37.896828 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08930a6-9bf9-4bca-8025-00037d2abe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:37.897422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08930a6-9bf9-4bca-8025-00037d2abe7b None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:37.897706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08930a6-9bf9-4bca-8025-00037d2abe7b None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:37.897976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08930a6-9bf9-4bca-8025-00037d2abe7b None admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:37.898720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08930a6-9bf9-4bca-8025-00037d2abe7b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:37.899022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08930a6-9bf9-4bca-8025-00037d2abe7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:37.900429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08930a6-9bf9-4bca-8025-00037d2abe7b None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:37.908700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:37.916961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 633/1268] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Aug 18 16:54:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:37.922672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c8aa-d8d3-4029-bd9d-fff26f235577 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:38.035036 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c8aa-d8d3-4029-bd9d-fff26f235577 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:38.073119 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bbdd1-88af-4e0d-ab21-b271169c1a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:38.073753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bbdd1-88af-4e0d-ab21-b271169c1a9b None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:38.074038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bbdd1-88af-4e0d-ab21-b271169c1a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:38.074308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bbdd1-88af-4e0d-ab21-b271169c1a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:38.085022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bbdd1-88af-4e0d-ab21-b271169c1a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:38.086456 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bbdd1-88af-4e0d-ab21-b271169c1a9b None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b73bbdd1-88af-4e0d-ab21-b271169c1a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:38.100777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:38.102466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:38.103539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:38.103539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:38.103539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:38.103539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 636/1269] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:38.109150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08930a6-9bf9-4bca-8025-00037d2abe7b None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:38.211836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08930a6-9bf9-4bca-8025-00037d2abe7b None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:38.247185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f8f0b-3ec2-4de5-9852-10998403aab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:38.247818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f8f0b-3ec2-4de5-9852-10998403aab9 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:38.248101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f8f0b-3ec2-4de5-9852-10998403aab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:38.248382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f8f0b-3ec2-4de5-9852-10998403aab9 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:38.249067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f8f0b-3ec2-4de5-9852-10998403aab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:38.249374 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f8f0b-3ec2-4de5-9852-10998403aab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:38.250743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f8f0b-3ec2-4de5-9852-10998403aab9 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:38.261937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 634/1270] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:38.267655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bbdd1-88af-4e0d-ab21-b271169c1a9b None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:38.304405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:38.385328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bbdd1-88af-4e0d-ab21-b271169c1a9b None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:38.420021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043a74a-a762-4397-9c6b-3bd7f4579b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:38.420684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043a74a-a762-4397-9c6b-3bd7f4579b30 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:38.420965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043a74a-a762-4397-9c6b-3bd7f4579b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:38.421238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043a74a-a762-4397-9c6b-3bd7f4579b30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:38.427867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043a74a-a762-4397-9c6b-3bd7f4579b30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:38.429275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043a74a-a762-4397-9c6b-3bd7f4579b30 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-1043a74a-a762-4397-9c6b-3bd7f4579b30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:54:38.442130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:38.443259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:38.444623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:54:38.444623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:54:38.444623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:54:38.444623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:54:38.444623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:54:38.444623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:54:38.444623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:38.444623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:38.444623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 637/1271] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:38.449443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f8f0b-3ec2-4de5-9852-10998403aab9 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:38.511494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:38.553476 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f8f0b-3ec2-4de5-9852-10998403aab9 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:38.586925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96bef5-5b8b-489a-ac78-c9ce3c5e2189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:38.587573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96bef5-5b8b-489a-ac78-c9ce3c5e2189 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:38.587806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96bef5-5b8b-489a-ac78-c9ce3c5e2189 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:38.588081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96bef5-5b8b-489a-ac78-c9ce3c5e2189 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:38.588854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96bef5-5b8b-489a-ac78-c9ce3c5e2189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:38.589115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96bef5-5b8b-489a-ac78-c9ce3c5e2189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:38.590562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96bef5-5b8b-489a-ac78-c9ce3c5e2189 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:38.603844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 635/1272] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:38.610179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043a74a-a762-4397-9c6b-3bd7f4579b30 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:38.698542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:38.708184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043a74a-a762-4397-9c6b-3bd7f4579b30 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:38.743079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875473c-03a8-45a9-9a20-f85e45dae009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:38.743744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875473c-03a8-45a9-9a20-f85e45dae009 None admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:38.744028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875473c-03a8-45a9-9a20-f85e45dae009 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:38.744309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875473c-03a8-45a9-9a20-f85e45dae009 None admin] PATH_INFO: `/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/4cc1ad7e47454b5d9d2ef2190414010c/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:38.746241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875473c-03a8-45a9-9a20-f85e45dae009 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7e1ec5606b47079057c3aa466c8537, user_id=4cc1ad7e47454b5d9d2ef2190414010c, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:38.747693 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875473c-03a8-45a9-9a20-f85e45dae009 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:38.761000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 638/1273] 10.222.0.81 () {58 vars in 1439 bytes} [Thu Aug 18 16:54:38 2022] PUT /identity/v3/projects/ea7e1ec5606b47079057c3aa466c8537/users/4cc1ad7e47454b5d9d2ef2190414010c/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 16:54:40.631667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ff1f6-da17-4f7c-9dbe-a3f89565f5ce None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:40.632240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ff1f6-da17-4f7c-9dbe-a3f89565f5ce None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:40.632240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ff1f6-da17-4f7c-9dbe-a3f89565f5ce None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:40.634130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 636/1274] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:54:40.639279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0abc-7cf1-4687-9a4a-9b04cca63cef None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:40.639714 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0abc-7cf1-4687-9a4a-9b04cca63cef None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:40.639815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0abc-7cf1-4687-9a4a-9b04cca63cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:40.659466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-655f0abc-7cf1-4687-9a4a-9b04cca63cef None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:40.660665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-655f0abc-7cf1-4687-9a4a-9b04cca63cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:40.733406 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 639/1275] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:54:41.016989 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ff1f6-da17-4f7c-9dbe-a3f89565f5ce None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:41.128922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ff1f6-da17-4f7c-9dbe-a3f89565f5ce None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:41.145900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:41.162908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3df19-bdca-4778-b61b-aee20a356084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:41.163620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3df19-bdca-4778-b61b-aee20a356084 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:41.163913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3df19-bdca-4778-b61b-aee20a356084 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:41.164713 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3df19-bdca-4778-b61b-aee20a356084 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:41.174784 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3df19-bdca-4778-b61b-aee20a356084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-34f3df19-bdca-4778-b61b-aee20a356084 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 16:54:41.179439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:41.181069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:41.182189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 637/1276] 10.222.0.81 () {56 vars in 1096 bytes} [Thu Aug 18 16:54:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:41.187443 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f0abc-7cf1-4687-9a4a-9b04cca63cef None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:41.266451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:41.286300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f0abc-7cf1-4687-9a4a-9b04cca63cef None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:41.321988 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9aca8-da79-479d-b29a-2f54a20abd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:41.322597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9aca8-da79-479d-b29a-2f54a20abd72 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:41.322883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9aca8-da79-479d-b29a-2f54a20abd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:41.323156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9aca8-da79-479d-b29a-2f54a20abd72 None admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:41.323818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9aca8-da79-479d-b29a-2f54a20abd72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:41.324124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9aca8-da79-479d-b29a-2f54a20abd72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:41.325511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9aca8-da79-479d-b29a-2f54a20abd72 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:41.333426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 640/1277] 10.222.0.81 () {56 vars in 1099 bytes} [Thu Aug 18 16:54:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:41.339357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3df19-bdca-4778-b61b-aee20a356084 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:41.437855 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3df19-bdca-4778-b61b-aee20a356084 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:41.470608 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49df6f-7117-4cba-83cf-fffa964ef629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:41.471229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49df6f-7117-4cba-83cf-fffa964ef629 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:41.471508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49df6f-7117-4cba-83cf-fffa964ef629 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:41.471779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49df6f-7117-4cba-83cf-fffa964ef629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:41.481820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49df6f-7117-4cba-83cf-fffa964ef629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:41.483249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49df6f-7117-4cba-83cf-fffa964ef629 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ec49df6f-7117-4cba-83cf-fffa964ef629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:41.497258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:41.498403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:41.499697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:41.499697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:41.499697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:41.499697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 638/1278] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:41.504268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9aca8-da79-479d-b29a-2f54a20abd72 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:41.600897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9aca8-da79-479d-b29a-2f54a20abd72 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:41.633637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12476ce8-374c-48d1-8194-05c7590c13d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:41.634235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12476ce8-374c-48d1-8194-05c7590c13d9 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:41.634513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12476ce8-374c-48d1-8194-05c7590c13d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:41.634791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12476ce8-374c-48d1-8194-05c7590c13d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:41.635425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12476ce8-374c-48d1-8194-05c7590c13d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:41.635734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12476ce8-374c-48d1-8194-05c7590c13d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:41.637121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12476ce8-374c-48d1-8194-05c7590c13d9 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:41.648992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 641/1279] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:41.654714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49df6f-7117-4cba-83cf-fffa964ef629 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:41.684738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:41.752819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49df6f-7117-4cba-83cf-fffa964ef629 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:41.786647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f21d0-9cff-4311-a97e-71eea33e3994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:41.787268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f21d0-9cff-4311-a97e-71eea33e3994 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:41.787547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f21d0-9cff-4311-a97e-71eea33e3994 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:41.787827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f21d0-9cff-4311-a97e-71eea33e3994 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:41.795565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f21d0-9cff-4311-a97e-71eea33e3994 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:41.797017 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f21d0-9cff-4311-a97e-71eea33e3994 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-1c6f21d0-9cff-4311-a97e-71eea33e3994 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 16:54:41.807704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:41.808919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:41.809949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 639/1280] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:41.814683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12476ce8-374c-48d1-8194-05c7590c13d9 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:41.818699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:41.912011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12476ce8-374c-48d1-8194-05c7590c13d9 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:41.944282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c0ac-b0ea-47a7-9528-ebd634088adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:41.944910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c0ac-b0ea-47a7-9528-ebd634088adb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:41.945712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c0ac-b0ea-47a7-9528-ebd634088adb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:41.945994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c0ac-b0ea-47a7-9528-ebd634088adb None admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:41.946710 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c0ac-b0ea-47a7-9528-ebd634088adb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:41.947016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c0ac-b0ea-47a7-9528-ebd634088adb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:41.948438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c0ac-b0ea-47a7-9528-ebd634088adb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:41.965724 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 642/1281] 10.222.0.81 () {56 vars in 1143 bytes} [Thu Aug 18 16:54:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:41.971654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f21d0-9cff-4311-a97e-71eea33e3994 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:42.062740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:42.072383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f21d0-9cff-4311-a97e-71eea33e3994 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:42.104538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c76e1d-bc60-4558-aed4-af11af011174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:42.105150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c76e1d-bc60-4558-aed4-af11af011174 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:42.105426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c76e1d-bc60-4558-aed4-af11af011174 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:42.105698 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c76e1d-bc60-4558-aed4-af11af011174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:42.170242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c76e1d-bc60-4558-aed4-af11af011174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:42.171687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c76e1d-bc60-4558-aed4-af11af011174 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:42.255686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:42.266522 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 640/1282] 10.222.0.81 () {58 vars in 1282 bytes} [Thu Aug 18 16:54:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 16:54:42.272286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c0ac-b0ea-47a7-9528-ebd634088adb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:42.332879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:42.370655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c0ac-b0ea-47a7-9528-ebd634088adb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:42.403589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590b8b1-3b7a-48fd-b347-0ee51d48efe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:42.404213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590b8b1-3b7a-48fd-b347-0ee51d48efe5 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:42.404512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590b8b1-3b7a-48fd-b347-0ee51d48efe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:42.404785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590b8b1-3b7a-48fd-b347-0ee51d48efe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:42.414948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590b8b1-3b7a-48fd-b347-0ee51d48efe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:42.416440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590b8b1-3b7a-48fd-b347-0ee51d48efe5 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-b590b8b1-3b7a-48fd-b347-0ee51d48efe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 16:54:42.431439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:42.432577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 16:54:42.433789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 16:54:42.433789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 16:54:42.433789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:42.433789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 643/1283] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:42.438670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c76e1d-bc60-4558-aed4-af11af011174 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:42.535672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c76e1d-bc60-4558-aed4-af11af011174 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:42.569532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0fa3c-bfc7-4862-a87c-da4126de7ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:42.570135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0fa3c-bfc7-4862-a87c-da4126de7ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:42.570441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0fa3c-bfc7-4862-a87c-da4126de7ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:42.570716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0fa3c-bfc7-4862-a87c-da4126de7ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:42.571353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0fa3c-bfc7-4862-a87c-da4126de7ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:42.571657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0fa3c-bfc7-4862-a87c-da4126de7ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:42.573051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0fa3c-bfc7-4862-a87c-da4126de7ad7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:42.583860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 641/1284] 10.222.0.81 () {56 vars in 1109 bytes} [Thu Aug 18 16:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:42.589514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590b8b1-3b7a-48fd-b347-0ee51d48efe5 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:42.687799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590b8b1-3b7a-48fd-b347-0ee51d48efe5 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:42.700968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:42.720593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476fd50-d961-4165-9e23-563ccc6f6fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:42.721229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476fd50-d961-4165-9e23-563ccc6f6fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:42.721509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476fd50-d961-4165-9e23-563ccc6f6fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:42.721780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476fd50-d961-4165-9e23-563ccc6f6fb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:42.729246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476fd50-d961-4165-9e23-563ccc6f6fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:42.730670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476fd50-d961-4165-9e23-563ccc6f6fb1 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application [None req-d476fd50-d961-4165-9e23-563ccc6f6fb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 16:54:42.742008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:42.743654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:42.744840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 16:54:42.744840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 16:54:42.744840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 16:54:42.744840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 16:54:42.744840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 16:54:42.744840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 16:54:42.744840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 16:54:42.744840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: ERROR keystone.server.flask.application Aug 18 16:54:42.744840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 644/1285] 10.222.0.81 () {56 vars in 1111 bytes} [Thu Aug 18 16:54:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:42.749500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0fa3c-bfc7-4862-a87c-da4126de7ad7 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:42.799941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:42.854885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0fa3c-bfc7-4862-a87c-da4126de7ad7 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:42.887867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5463e1c-a605-49ed-adc0-c74cff8718b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:42.888495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5463e1c-a605-49ed-adc0-c74cff8718b2 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:42.888769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5463e1c-a605-49ed-adc0-c74cff8718b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:42.889044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5463e1c-a605-49ed-adc0-c74cff8718b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:42.889732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5463e1c-a605-49ed-adc0-c74cff8718b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:42.890038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5463e1c-a605-49ed-adc0-c74cff8718b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:42.891461 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5463e1c-a605-49ed-adc0-c74cff8718b2 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:42.902856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 642/1286] 10.222.0.81 () {56 vars in 1148 bytes} [Thu Aug 18 16:54:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:42.908967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476fd50-d961-4165-9e23-563ccc6f6fb1 None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:43.007627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476fd50-d961-4165-9e23-563ccc6f6fb1 None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:43.040257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f96d3c-0553-4efb-a39a-a9d46b5c66cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:43.040881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f96d3c-0553-4efb-a39a-a9d46b5c66cc None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:43.041160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f96d3c-0553-4efb-a39a-a9d46b5c66cc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:43.041435 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f96d3c-0553-4efb-a39a-a9d46b5c66cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:43.042145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f96d3c-0553-4efb-a39a-a9d46b5c66cc None admin] RBAC: Adding query filter params (role.id=56228137a4444ef9b7e688d04abd00fd, scope.project.id=ea7e1ec5606b47079057c3aa466c8537, user.id=4cc1ad7e47454b5d9d2ef2190414010c) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:43.042451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f96d3c-0553-4efb-a39a-a9d46b5c66cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:43.043867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f96d3c-0553-4efb-a39a-a9d46b5c66cc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:43.049659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 645/1287] 10.222.0.81 () {56 vars in 1374 bytes} [Thu Aug 18 16:54:42 2022] GET /identity/v3/role_assignments?user.id=4cc1ad7e47454b5d9d2ef2190414010c&scope.project.id=ea7e1ec5606b47079057c3aa466c8537&role.id=56228137a4444ef9b7e688d04abd00fd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 16:54:44.946317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff286de0-b7b7-4599-99a8-8b899b1bda90 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:44.946864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff286de0-b7b7-4599-99a8-8b899b1bda90 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:44.946864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff286de0-b7b7-4599-99a8-8b899b1bda90 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:44.948213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 643/1288] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:54:44.953281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c270e-94bc-4e5f-a11a-b89255efa912 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:44.953711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c270e-94bc-4e5f-a11a-b89255efa912 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:44.953882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c270e-94bc-4e5f-a11a-b89255efa912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:44.971566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b11c270e-94bc-4e5f-a11a-b89255efa912 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:44.972789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b11c270e-94bc-4e5f-a11a-b89255efa912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:45.006831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:45.044610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 646/1289] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:54:45.309773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff286de0-b7b7-4599-99a8-8b899b1bda90 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:45.409032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff286de0-b7b7-4599-99a8-8b899b1bda90 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:45.419853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:45.444759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac565a3c-260e-4910-a299-9d35e4b4882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:45.445415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac565a3c-260e-4910-a299-9d35e4b4882a None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:45.445700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac565a3c-260e-4910-a299-9d35e4b4882a None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:45.445974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac565a3c-260e-4910-a299-9d35e4b4882a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:45.446569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac565a3c-260e-4910-a299-9d35e4b4882a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:45.447918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac565a3c-260e-4910-a299-9d35e4b4882a None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-ac565a3c-260e-4910-a299-9d35e4b4882a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:45.456541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:45.457819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:45.458895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 644/1290] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Aug 18 16:54:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:45.464162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c270e-94bc-4e5f-a11a-b89255efa912 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:45.562619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c270e-94bc-4e5f-a11a-b89255efa912 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:45.596047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45199725-fc84-43d2-8717-e7326c3f1525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:45.596677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199725-fc84-43d2-8717-e7326c3f1525 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:45.596957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199725-fc84-43d2-8717-e7326c3f1525 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:45.597230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199725-fc84-43d2-8717-e7326c3f1525 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:45.597856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45199725-fc84-43d2-8717-e7326c3f1525 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:45.598162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45199725-fc84-43d2-8717-e7326c3f1525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:45.599522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45199725-fc84-43d2-8717-e7326c3f1525 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:45.604449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 647/1291] 10.222.0.81 () {56 vars in 1116 bytes} [Thu Aug 18 16:54:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:45.610722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac565a3c-260e-4910-a299-9d35e4b4882a None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:45.708241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac565a3c-260e-4910-a299-9d35e4b4882a None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:45.741389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a327dea-7572-4f9d-b19d-6fd2c20f5e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:45.741998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a327dea-7572-4f9d-b19d-6fd2c20f5e4f None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:45.742281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a327dea-7572-4f9d-b19d-6fd2c20f5e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:45.742558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a327dea-7572-4f9d-b19d-6fd2c20f5e4f None admin] PATH_INFO: `/v3/services` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:45.743187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a327dea-7572-4f9d-b19d-6fd2c20f5e4f None admin] RBAC: Adding query filter params (type=placement) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:45.743494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a327dea-7572-4f9d-b19d-6fd2c20f5e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:45.744893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a327dea-7572-4f9d-b19d-6fd2c20f5e4f None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:45.749287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 645/1292] 10.222.0.81 () {56 vars in 1116 bytes} [Thu Aug 18 16:54:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:47.654193 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f3d2-31ec-4505-914e-b3ce637df57a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:47.654763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f3d2-31ec-4505-914e-b3ce637df57a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:47.654763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12f3d2-31ec-4505-914e-b3ce637df57a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:47.656098 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 648/1293] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:54:47.661268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aefc5-fc51-4ac5-8ba0-4b8c8e91ef6d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:47.661652 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aefc5-fc51-4ac5-8ba0-4b8c8e91ef6d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:47.661820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4aefc5-fc51-4ac5-8ba0-4b8c8e91ef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:47.679750 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ad4aefc5-fc51-4ac5-8ba0-4b8c8e91ef6d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:47.680950 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ad4aefc5-fc51-4ac5-8ba0-4b8c8e91ef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:47.709073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:47.747674 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 646/1294] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:54:48.020906 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12f3d2-31ec-4505-914e-b3ce637df57a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:48.060700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:48.129825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12f3d2-31ec-4505-914e-b3ce637df57a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:48.162902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35100415-a4eb-40c9-86fd-a75b701a4dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:48.163507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35100415-a4eb-40c9-86fd-a75b701a4dbc None admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:48.163817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35100415-a4eb-40c9-86fd-a75b701a4dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:48.164096 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35100415-a4eb-40c9-86fd-a75b701a4dbc None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:48.164764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35100415-a4eb-40c9-86fd-a75b701a4dbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:48.166133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35100415-a4eb-40c9-86fd-a75b701a4dbc None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:48.180549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 649/1295] 10.222.0.81 () {60 vars in 1141 bytes} [Thu Aug 18 16:54:48 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:54:50.055489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1489bfc-3136-44c4-8052-639fc59076b9 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:50.056001 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1489bfc-3136-44c4-8052-639fc59076b9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:50.056001 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1489bfc-3136-44c4-8052-639fc59076b9 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:50.057334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 647/1296] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:54:50.062624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5f055-bf55-47d0-a7ea-3410ca0696b6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:50.063041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5f055-bf55-47d0-a7ea-3410ca0696b6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:50.063157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5f055-bf55-47d0-a7ea-3410ca0696b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:50.080656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d3b5f055-bf55-47d0-a7ea-3410ca0696b6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:50.081818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d3b5f055-bf55-47d0-a7ea-3410ca0696b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:50.152187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 650/1297] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:54:50.417259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1489bfc-3136-44c4-8052-639fc59076b9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:50.517448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1489bfc-3136-44c4-8052-639fc59076b9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:50.549755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a29177-935c-439b-9051-5e5b52d1e970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:50.550380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29177-935c-439b-9051-5e5b52d1e970 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:50.550663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29177-935c-439b-9051-5e5b52d1e970 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:50.550937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29177-935c-439b-9051-5e5b52d1e970 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:50.551516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29177-935c-439b-9051-5e5b52d1e970 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:50.552909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29177-935c-439b-9051-5e5b52d1e970 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-39a29177-935c-439b-9051-5e5b52d1e970 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:50.561958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:50.563107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:50.563971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 648/1298] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Aug 18 16:54:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:50.569310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5f055-bf55-47d0-a7ea-3410ca0696b6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:50.588302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:50.669475 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5f055-bf55-47d0-a7ea-3410ca0696b6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:50.703642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e80258-bb62-432c-ad24-ebdf3f273fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:50.704257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80258-bb62-432c-ad24-ebdf3f273fdb None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:50.704577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80258-bb62-432c-ad24-ebdf3f273fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:50.704854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80258-bb62-432c-ad24-ebdf3f273fdb None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:50.705476 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e80258-bb62-432c-ad24-ebdf3f273fdb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:50.705785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e80258-bb62-432c-ad24-ebdf3f273fdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:50.707146 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e80258-bb62-432c-ad24-ebdf3f273fdb None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:50.712190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 651/1299] 10.222.0.81 () {56 vars in 1116 bytes} [Thu Aug 18 16:54:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:50.718281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a29177-935c-439b-9051-5e5b52d1e970 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:50.749937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:50.817142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a29177-935c-439b-9051-5e5b52d1e970 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:50.849381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3490bc-539d-4ace-acc6-ce77979c5ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:50.849990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3490bc-539d-4ace-acc6-ce77979c5ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:50.850277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3490bc-539d-4ace-acc6-ce77979c5ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:50.850556 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3490bc-539d-4ace-acc6-ce77979c5ae7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:50.851777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3490bc-539d-4ace-acc6-ce77979c5ae7 None admin] RBAC: Adding query filter params (interface=public, service_id=3836d3c0a06b4d89b19cc2120b464021, region_id=RegionOne) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:50.852089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3490bc-539d-4ace-acc6-ce77979c5ae7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:50.853481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3490bc-539d-4ace-acc6-ce77979c5ae7 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:50.858631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 649/1300] 10.222.0.81 () {56 vars in 1251 bytes} [Thu Aug 18 16:54:50 2022] GET /identity/v3/endpoints?service_id=3836d3c0a06b4d89b19cc2120b464021&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:50.864321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e80258-bb62-432c-ad24-ebdf3f273fdb None admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:50.943336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:50.961160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e80258-bb62-432c-ad24-ebdf3f273fdb None admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:50.995890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e34850-a073-4ffa-97fe-11a641a90a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:50.996666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34850-a073-4ffa-97fe-11a641a90a5e None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:50.997001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34850-a073-4ffa-97fe-11a641a90a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:50.997308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34850-a073-4ffa-97fe-11a641a90a5e None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:50.997981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e34850-a073-4ffa-97fe-11a641a90a5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:50.999662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e34850-a073-4ffa-97fe-11a641a90a5e None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:51.007852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 652/1301] 10.222.0.81 () {56 vars in 1087 bytes} [Thu Aug 18 16:54:50 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 16:54:52.895748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdcfd3-91b2-49d9-9fd1-02d270d60d25 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:52.896276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdcfd3-91b2-49d9-9fd1-02d270d60d25 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:52.896276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdcfd3-91b2-49d9-9fd1-02d270d60d25 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:52.897678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 650/1302] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:54:52.902759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c159e2a-257b-44f0-af1b-8f03c1c05830 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:52.903225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c159e2a-257b-44f0-af1b-8f03c1c05830 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:52.903316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c159e2a-257b-44f0-af1b-8f03c1c05830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:52.920944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4c159e2a-257b-44f0-af1b-8f03c1c05830 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:54:52.922127 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4c159e2a-257b-44f0-af1b-8f03c1c05830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:54:52.990569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 653/1303] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:54:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 16:54:53.259123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdcfd3-91b2-49d9-9fd1-02d270d60d25 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:53.352294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:53.359432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdcfd3-91b2-49d9-9fd1-02d270d60d25 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:53.392994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b32da-5867-4e8a-a2d9-b8c25a8363b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:53.393653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b32da-5867-4e8a-a2d9-b8c25a8363b8 None admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:53.393939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b32da-5867-4e8a-a2d9-b8c25a8363b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:53.394216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b32da-5867-4e8a-a2d9-b8c25a8363b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:53.394857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b32da-5867-4e8a-a2d9-b8c25a8363b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:53.396153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b32da-5867-4e8a-a2d9-b8c25a8363b8 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application [None req-208b32da-5867-4e8a-a2d9-b8c25a8363b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 16:54:53.405149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 16:54:53.406327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application with Lock( Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self._enter() Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application return self.creator() Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application created_value = creator( Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: ERROR keystone.server.flask.application Aug 18 16:54:53.407423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 651/1304] 10.222.0.81 () {56 vars in 1117 bytes} [Thu Aug 18 16:54:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 16:54:53.412258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c159e2a-257b-44f0-af1b-8f03c1c05830 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:53.486151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:54:53.510706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c159e2a-257b-44f0-af1b-8f03c1c05830 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:53.543205 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee5289-0c6f-4763-8307-31a978d06743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:53.543809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5289-0c6f-4763-8307-31a978d06743 None admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:53.544090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5289-0c6f-4763-8307-31a978d06743 None admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:53.544366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5289-0c6f-4763-8307-31a978d06743 None admin] PATH_INFO: `/v3/services` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:53.545021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee5289-0c6f-4763-8307-31a978d06743 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 16:54:53.545327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee5289-0c6f-4763-8307-31a978d06743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:53.546690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee5289-0c6f-4763-8307-31a978d06743 None admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:53.551631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 654/1305] 10.222.0.81 () {56 vars in 1116 bytes} [Thu Aug 18 16:54:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 16:54:53.557914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b32da-5867-4e8a-a2d9-b8c25a8363b8 None admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:54:53.657171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b32da-5867-4e8a-a2d9-b8c25a8363b8 None admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:54:53.689655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ef738-cc72-436d-b620-7d31724eeda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:54:53.690262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef738-cc72-436d-b620-7d31724eeda4 None admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:54:53.690547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef738-cc72-436d-b620-7d31724eeda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:54:53.690822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ef738-cc72-436d-b620-7d31724eeda4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:54:53.691489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ef738-cc72-436d-b620-7d31724eeda4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:54:53.692887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ef738-cc72-436d-b620-7d31724eeda4 None admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:54:53.712273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 652/1306] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 16:54:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 16:55:03.548719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=30 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:55:03.707953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:55:59.380315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a6281-954a-461f-88e7-f77e96da8e5a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:55:59.380948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a6281-954a-461f-88e7-f77e96da8e5a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:55:59.380948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a6281-954a-461f-88e7-f77e96da8e5a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:55:59.387424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85eb0-ede9-4b54-ad86-f6b3f03f8126 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:55:59.387901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85eb0-ede9-4b54-ad86-f6b3f03f8126 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:55:59.387986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85eb0-ede9-4b54-ad86-f6b3f03f8126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:55:59.392666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 655/1307] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:55:59 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:55:59.464085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3ca85eb0-ede9-4b54-ad86-f6b3f03f8126 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:55:59.465565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3ca85eb0-ede9-4b54-ad86-f6b3f03f8126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:55:59.581454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 653/1308] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:55:59.898062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012326-df4d-43d0-a3e7-51fec258dc7b None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:55:59.898275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012326-df4d-43d0-a3e7-51fec258dc7b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:55:59.898564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08012326-df4d-43d0-a3e7-51fec258dc7b None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:55:59.899900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 656/1309] 10.222.0.81 () {54 vars in 965 bytes} [Thu Aug 18 16:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:55:59.906382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6395a-2d33-4795-afd2-bb1735bfd75d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:55:59.906704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6395a-2d33-4795-afd2-bb1735bfd75d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:55:59.906959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6395a-2d33-4795-afd2-bb1735bfd75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:00.005266 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-25b6395a-2d33-4795-afd2-bb1735bfd75d None None] MFA Rules not processed for user `7b1fde904acd460899d8c736f5762056`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:00.006676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-25b6395a-2d33-4795-afd2-bb1735bfd75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:00.030762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:00.117450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 654/1310] 10.222.0.81 () {58 vars in 1062 bytes} [Thu Aug 18 16:55:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:00.126964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08012326-df4d-43d0-a3e7-51fec258dc7b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:00.128915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-08012326-df4d-43d0-a3e7-51fec258dc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:00.311993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08012326-df4d-43d0-a3e7-51fec258dc7b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:00.423652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95242f3-561b-4b52-88e0-513c2b717bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:00.424320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95242f3-561b-4b52-88e0-513c2b717bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:00.424836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95242f3-561b-4b52-88e0-513c2b717bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:00.425090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95242f3-561b-4b52-88e0-513c2b717bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:00.426771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a95242f3-561b-4b52-88e0-513c2b717bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:00.486845 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:00.551526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95242f3-561b-4b52-88e0-513c2b717bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:00.553131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95242f3-561b-4b52-88e0-513c2b717bf0 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:00.574241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 657/1311] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:02.798175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3e6fa-c14d-44f8-8870-fc76f8840dfe None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:02.798603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3e6fa-c14d-44f8-8870-fc76f8840dfe None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:02.798767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3e6fa-c14d-44f8-8870-fc76f8840dfe None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:02.800143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 655/1312] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:02.806423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc3986-b835-40d4-82ae-b3286d9bc2c4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:02.806934 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc3986-b835-40d4-82ae-b3286d9bc2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:02.807017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc3986-b835-40d4-82ae-b3286d9bc2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:02.913027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-00cc3986-b835-40d4-82ae-b3286d9bc2c4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:02.914280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-00cc3986-b835-40d4-82ae-b3286d9bc2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:03.023743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 658/1313] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:03.312289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3e6fa-c14d-44f8-8870-fc76f8840dfe None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:03.313947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-37e3e6fa-c14d-44f8-8870-fc76f8840dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:03.448106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3e6fa-c14d-44f8-8870-fc76f8840dfe None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:03.528848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:03.531773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372f6d9-b7d2-48a2-a9d0-93f42fd4b663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:03.532542 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f6d9-b7d2-48a2-a9d0-93f42fd4b663 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:03.532852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f6d9-b7d2-48a2-a9d0-93f42fd4b663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:03.533616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f6d9-b7d2-48a2-a9d0-93f42fd4b663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:03.536254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0372f6d9-b7d2-48a2-a9d0-93f42fd4b663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:03.651490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372f6d9-b7d2-48a2-a9d0-93f42fd4b663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:03.653270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372f6d9-b7d2-48a2-a9d0-93f42fd4b663 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:03.673056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 656/1314] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:05.970804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30002f-e20c-4f9e-b2ce-bab128a71d95 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:05.971384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30002f-e20c-4f9e-b2ce-bab128a71d95 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:05.971384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30002f-e20c-4f9e-b2ce-bab128a71d95 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:05.973301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 659/1315] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:05.978645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a8cd9-1d5a-4bb7-a8f8-bb95cc107ea0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:05.979133 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a8cd9-1d5a-4bb7-a8f8-bb95cc107ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:05.979240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a8cd9-1d5a-4bb7-a8f8-bb95cc107ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:06.048284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-288a8cd9-1d5a-4bb7-a8f8-bb95cc107ea0 None None] MFA Rules not processed for user `735fc3fffec44536b08892ae5de87f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:06.049455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-288a8cd9-1d5a-4bb7-a8f8-bb95cc107ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:06.103741 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:06.148970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 657/1316] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:06.434716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30002f-e20c-4f9e-b2ce-bab128a71d95 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:06.436266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-be30002f-e20c-4f9e-b2ce-bab128a71d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:06.446996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:06.540542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30002f-e20c-4f9e-b2ce-bab128a71d95 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:06.611396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb15172-e6c4-4aca-a0b7-7c221e212970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:06.612005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb15172-e6c4-4aca-a0b7-7c221e212970 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:06.612281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb15172-e6c4-4aca-a0b7-7c221e212970 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:06.612578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb15172-e6c4-4aca-a0b7-7c221e212970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:06.614722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6cb15172-e6c4-4aca-a0b7-7c221e212970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:06.676296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:06.722116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb15172-e6c4-4aca-a0b7-7c221e212970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:06.723973 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb15172-e6c4-4aca-a0b7-7c221e212970 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:06.743203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 660/1317] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:06 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:09.199089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d98457-471b-4f66-a3ef-617409d573b8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:09.199643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d98457-471b-4f66-a3ef-617409d573b8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:09.199643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d98457-471b-4f66-a3ef-617409d573b8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:09.201009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 658/1318] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:09.206044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9676535-7630-4993-8b13-ee75bb8515f3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:09.206453 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9676535-7630-4993-8b13-ee75bb8515f3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:09.206596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9676535-7630-4993-8b13-ee75bb8515f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:09.271476 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d9676535-7630-4993-8b13-ee75bb8515f3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:09.272703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d9676535-7630-4993-8b13-ee75bb8515f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:09.367827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 661/1319] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:56:09.646669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d98457-471b-4f66-a3ef-617409d573b8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:09.648231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-09d98457-471b-4f66-a3ef-617409d573b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:09.751399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d98457-471b-4f66-a3ef-617409d573b8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:09.823170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5cced-1491-4885-a481-74556f78fb3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:09.823780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5cced-1491-4885-a481-74556f78fb3e service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:09.824062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5cced-1491-4885-a481-74556f78fb3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:09.824335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5cced-1491-4885-a481-74556f78fb3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:09.825975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d5f5cced-1491-4885-a481-74556f78fb3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:09.833474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:09.936920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5cced-1491-4885-a481-74556f78fb3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:09.938359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5cced-1491-4885-a481-74556f78fb3e service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:09.955988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 659/1320] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:12.517139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02f980-3039-4dee-9221-263c0fab806a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:12.517775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02f980-3039-4dee-9221-263c0fab806a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:12.517775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02f980-3039-4dee-9221-263c0fab806a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:12.519685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 662/1321] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:12.524897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8559d0-2ac6-4976-99c0-8add5ec08b0f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:12.525336 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8559d0-2ac6-4976-99c0-8add5ec08b0f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:12.525484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8559d0-2ac6-4976-99c0-8add5ec08b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:12.591833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-fb8559d0-2ac6-4976-99c0-8add5ec08b0f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:12.593070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fb8559d0-2ac6-4976-99c0-8add5ec08b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:12.650746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:12.690269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 660/1322] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:12.970333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02f980-3039-4dee-9221-263c0fab806a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:12.971908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bb02f980-3039-4dee-9221-263c0fab806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:12.992603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:13.080390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02f980-3039-4dee-9221-263c0fab806a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:13.156094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80125d1-a1ba-43fb-9c9e-af2d6bf228b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:13.156780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80125d1-a1ba-43fb-9c9e-af2d6bf228b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:13.157068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80125d1-a1ba-43fb-9c9e-af2d6bf228b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:13.157348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80125d1-a1ba-43fb-9c9e-af2d6bf228b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:13.158970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d80125d1-a1ba-43fb-9c9e-af2d6bf228b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:13.230498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:13.268237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80125d1-a1ba-43fb-9c9e-af2d6bf228b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:13.270214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80125d1-a1ba-43fb-9c9e-af2d6bf228b5 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:13.289718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 663/1323] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:15.263508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d665b-070c-4a50-9308-b38a12900d2f None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:15.264069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d665b-070c-4a50-9308-b38a12900d2f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:15.264069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d665b-070c-4a50-9308-b38a12900d2f None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:15.265347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 661/1324] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:15.271010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc2a3f-6fc1-4ace-ae29-56c4a298a40f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:15.271478 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc2a3f-6fc1-4ace-ae29-56c4a298a40f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:15.271592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc2a3f-6fc1-4ace-ae29-56c4a298a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:15.339958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b5bc2a3f-6fc1-4ace-ae29-56c4a298a40f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:15.341201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b5bc2a3f-6fc1-4ace-ae29-56c4a298a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:15.436524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 664/1325] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:56:15.717353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d665b-070c-4a50-9308-b38a12900d2f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:15.718903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a59d665b-070c-4a50-9308-b38a12900d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:15.828379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d665b-070c-4a50-9308-b38a12900d2f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:15.908407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd86307-aa9f-45ce-ac18-1a9dfe2d74ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:15.909104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd86307-aa9f-45ce-ac18-1a9dfe2d74ed service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:15.909392 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd86307-aa9f-45ce-ac18-1a9dfe2d74ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:15.909694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd86307-aa9f-45ce-ac18-1a9dfe2d74ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:15.911293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dfd86307-aa9f-45ce-ac18-1a9dfe2d74ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:15.929091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:16.022715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd86307-aa9f-45ce-ac18-1a9dfe2d74ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:16.024154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd86307-aa9f-45ce-ac18-1a9dfe2d74ed service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:16.044412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 662/1326] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:17.998740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cb17f-755c-4a36-89a8-d3d9eadc2794 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:17.999358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cb17f-755c-4a36-89a8-d3d9eadc2794 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:17.999358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cb17f-755c-4a36-89a8-d3d9eadc2794 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:18.000603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 665/1327] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:18.006638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62fc0c-83f4-4064-b686-134b9f8b2b0a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:18.007130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62fc0c-83f4-4064-b686-134b9f8b2b0a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:18.007235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62fc0c-83f4-4064-b686-134b9f8b2b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:18.080043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8d62fc0c-83f4-4064-b686-134b9f8b2b0a None None] MFA Rules not processed for user `735fc3fffec44536b08892ae5de87f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:18.081347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8d62fc0c-83f4-4064-b686-134b9f8b2b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:18.149925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:18.182495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 663/1328] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:18.493296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc33f2-b21e-4b7a-b2c2-41936a5a5fc4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:18.493552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc33f2-b21e-4b7a-b2c2-41936a5a5fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:18.493876 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc33f2-b21e-4b7a-b2c2-41936a5a5fc4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:18.495317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 666/1329] 10.222.0.81 () {54 vars in 965 bytes} [Thu Aug 18 16:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:18.501353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181913-5ce8-428a-be23-04980f8121b1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:18.501646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181913-5ce8-428a-be23-04980f8121b1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:18.501931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c181913-5ce8-428a-be23-04980f8121b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:18.591888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3c181913-5ce8-428a-be23-04980f8121b1 None None] MFA Rules not processed for user `7b1fde904acd460899d8c736f5762056`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:18.593156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3c181913-5ce8-428a-be23-04980f8121b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:18.670216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 664/1330] 10.222.0.81 () {58 vars in 1062 bytes} [Thu Aug 18 16:56:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:18.680013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc33f2-b21e-4b7a-b2c2-41936a5a5fc4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:18.681577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3afc33f2-b21e-4b7a-b2c2-41936a5a5fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:18.712804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:18.789059 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc33f2-b21e-4b7a-b2c2-41936a5a5fc4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:18.873539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6a65f-dc0c-4008-8c44-e32c6e55f6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:18.874144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a65f-dc0c-4008-8c44-e32c6e55f6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:18.874428 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a65f-dc0c-4008-8c44-e32c6e55f6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:18.874701 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a65f-dc0c-4008-8c44-e32c6e55f6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:18.876322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1db6a65f-dc0c-4008-8c44-e32c6e55f6b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:18.958278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:18.992558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6a65f-dc0c-4008-8c44-e32c6e55f6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:18.994097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6a65f-dc0c-4008-8c44-e32c6e55f6b0 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:19.012397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 667/1331] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:21.553066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad724bf-57fc-4920-9535-9b594fca2351 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:21.555070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad724bf-57fc-4920-9535-9b594fca2351 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:21.555070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad724bf-57fc-4920-9535-9b594fca2351 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:21.555272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 665/1332] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:21.560377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62994a46-396a-4609-9657-4f32d697a9aa None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:21.560838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62994a46-396a-4609-9657-4f32d697a9aa None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:21.560948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62994a46-396a-4609-9657-4f32d697a9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:21.625969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-62994a46-396a-4609-9657-4f32d697a9aa None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:21.627172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-62994a46-396a-4609-9657-4f32d697a9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:21.720942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 668/1333] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:21.998712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad724bf-57fc-4920-9535-9b594fca2351 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:22.000267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5ad724bf-57fc-4920-9535-9b594fca2351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:22.070024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:22.105155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad724bf-57fc-4920-9535-9b594fca2351 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:22.178134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65295293-a9e0-4505-8b77-ca0b2c96d1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:22.178747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65295293-a9e0-4505-8b77-ca0b2c96d1db service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:22.179029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65295293-a9e0-4505-8b77-ca0b2c96d1db service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:22.179302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65295293-a9e0-4505-8b77-ca0b2c96d1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:22.180943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-65295293-a9e0-4505-8b77-ca0b2c96d1db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:22.286877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65295293-a9e0-4505-8b77-ca0b2c96d1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:22.288222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65295293-a9e0-4505-8b77-ca0b2c96d1db service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:22.298034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:22.306915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 666/1334] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:24.251267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82fc0-5866-4bcc-a0f8-6d0f45651acf None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:24.251869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82fc0-5866-4bcc-a0f8-6d0f45651acf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:24.251869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb82fc0-5866-4bcc-a0f8-6d0f45651acf None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:24.253209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 669/1335] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:24.258825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a534ac-a706-47b3-86b6-5670dc15974c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:24.259268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a534ac-a706-47b3-86b6-5670dc15974c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:24.259371 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a534ac-a706-47b3-86b6-5670dc15974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:24.323834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f1a534ac-a706-47b3-86b6-5670dc15974c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:24.325055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f1a534ac-a706-47b3-86b6-5670dc15974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:24.419924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 667/1336] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:24.705012 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb82fc0-5866-4bcc-a0f8-6d0f45651acf None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:24.706678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9fb82fc0-5866-4bcc-a0f8-6d0f45651acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:24.748183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:24.811228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb82fc0-5866-4bcc-a0f8-6d0f45651acf None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:24.884350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58e473-fe30-439b-a0bd-0779d5d84833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:24.884996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58e473-fe30-439b-a0bd-0779d5d84833 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:24.885275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58e473-fe30-439b-a0bd-0779d5d84833 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:24.885547 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58e473-fe30-439b-a0bd-0779d5d84833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:24.887156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ca58e473-fe30-439b-a0bd-0779d5d84833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:24.969164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:24.995438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58e473-fe30-439b-a0bd-0779d5d84833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:24.997043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58e473-fe30-439b-a0bd-0779d5d84833 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:25.014838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 670/1337] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:27.402384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2d98a-e008-4965-8e7d-16c530e99ede None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:27.402952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2d98a-e008-4965-8e7d-16c530e99ede None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:27.402952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2d98a-e008-4965-8e7d-16c530e99ede None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:27.404284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 668/1338] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:27.409334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1aef6-8778-47d5-9fac-77f33e7b4305 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:27.409822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1aef6-8778-47d5-9fac-77f33e7b4305 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:27.410430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1aef6-8778-47d5-9fac-77f33e7b4305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:27.475948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7ed1aef6-8778-47d5-9fac-77f33e7b4305 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:27.477200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7ed1aef6-8778-47d5-9fac-77f33e7b4305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:27.573568 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 671/1339] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:27.862097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2d98a-e008-4965-8e7d-16c530e99ede None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:27.864257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-21d2d98a-e008-4965-8e7d-16c530e99ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:27.939250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:27.966525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2d98a-e008-4965-8e7d-16c530e99ede None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:28.041521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f906de-167e-4f44-b006-8889206fbf32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:28.042057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f906de-167e-4f44-b006-8889206fbf32 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:28.042339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f906de-167e-4f44-b006-8889206fbf32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:28.042643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f906de-167e-4f44-b006-8889206fbf32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:28.044291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-62f906de-167e-4f44-b006-8889206fbf32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:28.156485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f906de-167e-4f44-b006-8889206fbf32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:28.157947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f906de-167e-4f44-b006-8889206fbf32 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:28.176389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 669/1340] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:32.122276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3a999-a088-4a5e-a593-3e477b0a8261 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:32.122812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3a999-a088-4a5e-a593-3e477b0a8261 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:32.122927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3a999-a088-4a5e-a593-3e477b0a8261 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:32.124679 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 672/1341] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:32.130327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529c47-faf6-49ec-8cff-b49365d3b2be None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:32.130815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529c47-faf6-49ec-8cff-b49365d3b2be None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:32.130934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f529c47-faf6-49ec-8cff-b49365d3b2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:32.144977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:32.214189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0f529c47-faf6-49ec-8cff-b49365d3b2be None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:32.215416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0f529c47-faf6-49ec-8cff-b49365d3b2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:32.317924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 670/1342] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:32.600231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3a999-a088-4a5e-a593-3e477b0a8261 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:32.601837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-18c3a999-a088-4a5e-a593-3e477b0a8261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:32.652050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:32.708851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3a999-a088-4a5e-a593-3e477b0a8261 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:32.788365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc70824-9c21-4b28-bb1a-917f392efa50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:32.789007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70824-9c21-4b28-bb1a-917f392efa50 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:32.789286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70824-9c21-4b28-bb1a-917f392efa50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:32.789558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70824-9c21-4b28-bb1a-917f392efa50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:32.791155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7fc70824-9c21-4b28-bb1a-917f392efa50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:32.888648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:32.905498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc70824-9c21-4b28-bb1a-917f392efa50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:32.906949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc70824-9c21-4b28-bb1a-917f392efa50 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:32.927595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 673/1343] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:35.458276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bf09a-24c0-49d8-9ff2-466a20406bd4 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:35.458840 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bf09a-24c0-49d8-9ff2-466a20406bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:35.458840 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bf09a-24c0-49d8-9ff2-466a20406bd4 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:35.460203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 671/1344] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:35.466122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e799ea-5ab6-416f-ba84-88f4cae2fbda None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:35.466682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e799ea-5ab6-416f-ba84-88f4cae2fbda None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:35.466682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e799ea-5ab6-416f-ba84-88f4cae2fbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:35.535626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-77e799ea-5ab6-416f-ba84-88f4cae2fbda None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:35.536932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-77e799ea-5ab6-416f-ba84-88f4cae2fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:35.635845 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 674/1345] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:35.915439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bf09a-24c0-49d8-9ff2-466a20406bd4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:35.917019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fb7bf09a-24c0-49d8-9ff2-466a20406bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:36.005963 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:36.025706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bf09a-24c0-49d8-9ff2-466a20406bd4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:36.109716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8c3e2-ee4f-4719-a251-d3536f12a527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:36.110345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c3e2-ee4f-4719-a251-d3536f12a527 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:36.110623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c3e2-ee4f-4719-a251-d3536f12a527 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:36.110892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8c3e2-ee4f-4719-a251-d3536f12a527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:36.112673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bab8c3e2-ee4f-4719-a251-d3536f12a527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:36.228065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8c3e2-ee4f-4719-a251-d3536f12a527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:36.229807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8c3e2-ee4f-4719-a251-d3536f12a527 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:36.250852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 672/1346] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:56:40.244300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0720cf1-7856-4148-a382-51548cf95476 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:40.244847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0720cf1-7856-4148-a382-51548cf95476 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:40.244930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0720cf1-7856-4148-a382-51548cf95476 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:40.246247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 675/1347] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:40.252779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a460fc-39d9-4c78-a01a-19d0d5c2f8b0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:40.253284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a460fc-39d9-4c78-a01a-19d0d5c2f8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:40.253401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a460fc-39d9-4c78-a01a-19d0d5c2f8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:40.270507 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:40.324959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-54a460fc-39d9-4c78-a01a-19d0d5c2f8b0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:40.326204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-54a460fc-39d9-4c78-a01a-19d0d5c2f8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:40.429624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 673/1348] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:40.710331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0720cf1-7856-4148-a382-51548cf95476 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:40.711870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b0720cf1-7856-4148-a382-51548cf95476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:40.773313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:40.822373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0720cf1-7856-4148-a382-51548cf95476 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:40.908843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a293ad-52ed-424a-bc92-ce0bb53fd590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:40.909464 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a293ad-52ed-424a-bc92-ce0bb53fd590 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:40.909745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a293ad-52ed-424a-bc92-ce0bb53fd590 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:40.910068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a293ad-52ed-424a-bc92-ce0bb53fd590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:40.911772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e8a293ad-52ed-424a-bc92-ce0bb53fd590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:41.020851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:41.025223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a293ad-52ed-424a-bc92-ce0bb53fd590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:41.026687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a293ad-52ed-424a-bc92-ce0bb53fd590 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:41.053304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 676/1349] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:45.953781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7dbcc-c690-4d39-9db4-1fe14d738241 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:45.954465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7dbcc-c690-4d39-9db4-1fe14d738241 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:45.954465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7dbcc-c690-4d39-9db4-1fe14d738241 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:45.956084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 674/1350] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 16:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:45.962234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6615ece-838d-4fb8-a778-56a8ffa0846b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:45.963118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6615ece-838d-4fb8-a778-56a8ffa0846b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:45.963716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6615ece-838d-4fb8-a778-56a8ffa0846b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:46.072677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e6615ece-838d-4fb8-a778-56a8ffa0846b None None] MFA Rules not processed for user `4cc1ad7e47454b5d9d2ef2190414010c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:46.074017 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e6615ece-838d-4fb8-a778-56a8ffa0846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:46.229488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 677/1351] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 16:56:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:50.424400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db96f7-9944-4ecb-86c1-59959b9597c2 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:50.425023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db96f7-9944-4ecb-86c1-59959b9597c2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:50.425023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db96f7-9944-4ecb-86c1-59959b9597c2 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:50.427181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 675/1352] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 16:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:50.427635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=59 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:50.433453 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2848-5fd6-4413-b829-4daa459d03f8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:50.433993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2848-5fd6-4413-b829-4daa459d03f8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:50.433993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2848-5fd6-4413-b829-4daa459d03f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:50.516618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:50.542538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-201b2848-5fd6-4413-b829-4daa459d03f8 None None] MFA Rules not processed for user `4cc1ad7e47454b5d9d2ef2190414010c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:50.545177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-201b2848-5fd6-4413-b829-4daa459d03f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:50.672046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 678/1353] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 16:56:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:51.991075 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608f390-8902-433f-adc7-efbb5a3ef265 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:51.991582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608f390-8902-433f-adc7-efbb5a3ef265 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:51.991582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608f390-8902-433f-adc7-efbb5a3ef265 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:51.992896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 676/1354] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 16:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:51.998446 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599564c-8fea-4dab-ac90-bc135231a9e3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:51.998901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599564c-8fea-4dab-ac90-bc135231a9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:51.999035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599564c-8fea-4dab-ac90-bc135231a9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:52.077363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3599564c-8fea-4dab-ac90-bc135231a9e3 None None] MFA Rules not processed for user `4cc1ad7e47454b5d9d2ef2190414010c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:52.078550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3599564c-8fea-4dab-ac90-bc135231a9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:52.120435 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:52.188251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 679/1355] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 16:56:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:56:55.471479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb6c2-bb8a-4a9a-8a53-b744b461b7c6 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:55.472117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb6c2-bb8a-4a9a-8a53-b744b461b7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:55.472117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb6c2-bb8a-4a9a-8a53-b744b461b7c6 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:55.473956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 677/1356] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:56:55.479685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889433-9240-41ab-a67b-fe38c4647ffd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:55.480133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889433-9240-41ab-a67b-fe38c4647ffd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:55.480282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7889433-9240-41ab-a67b-fe38c4647ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:55.559853 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e7889433-9240-41ab-a67b-fe38c4647ffd None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:55.561164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e7889433-9240-41ab-a67b-fe38c4647ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:55.714255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 680/1357] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:56.020208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0198-aa65-4515-8d61-92a39e77e5fe None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:56.020904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0198-aa65-4515-8d61-92a39e77e5fe None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:56.021355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0198-aa65-4515-8d61-92a39e77e5fe None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:56.022709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 678/1358] 10.222.0.81 () {54 vars in 962 bytes} [Thu Aug 18 16:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:56.032240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d93b-b319-4a43-960d-f02fd0d8bcfe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:56.032674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d93b-b319-4a43-960d-f02fd0d8bcfe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:56.033185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d93b-b319-4a43-960d-f02fd0d8bcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:56.061484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:56.134155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0c05d93b-b319-4a43-960d-f02fd0d8bcfe None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:56.135849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0c05d93b-b319-4a43-960d-f02fd0d8bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:56.294151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 681/1359] 10.222.0.81 () {58 vars in 1059 bytes} [Thu Aug 18 16:56:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:56:56.300641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b0198-aa65-4515-8d61-92a39e77e5fe None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:56.302219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-402b0198-aa65-4515-8d61-92a39e77e5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:56.471477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b0198-aa65-4515-8d61-92a39e77e5fe None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:56.551973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:56.597185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de246721-286c-4eff-bd45-1328c97e8ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:56.597806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246721-286c-4eff-bd45-1328c97e8ef8 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:56.598085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246721-286c-4eff-bd45-1328c97e8ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:56.598353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de246721-286c-4eff-bd45-1328c97e8ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:56.599956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-de246721-286c-4eff-bd45-1328c97e8ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:56.699508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de246721-286c-4eff-bd45-1328c97e8ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:56.701169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de246721-286c-4eff-bd45-1328c97e8ef8 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:56.720745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 679/1360] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:56:58.857312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e25f-c624-4ad3-99d0-919911dcfb85 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:58.857837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e25f-c624-4ad3-99d0-919911dcfb85 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:58.857837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e25f-c624-4ad3-99d0-919911dcfb85 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:58.859413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 682/1361] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:56:58.864962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7bd34-6455-4fc8-82ec-19263a46498d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:58.865410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7bd34-6455-4fc8-82ec-19263a46498d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:58.865618 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7bd34-6455-4fc8-82ec-19263a46498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:58.934935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-89a7bd34-6455-4fc8-82ec-19263a46498d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:56:58.936120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-89a7bd34-6455-4fc8-82ec-19263a46498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:58.976396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:59.057118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 680/1362] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:56:59.353924 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e25f-c624-4ad3-99d0-919911dcfb85 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:56:59.356136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3413e25f-c624-4ad3-99d0-919911dcfb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:59.427209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:59.518568 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e25f-c624-4ad3-99d0-919911dcfb85 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:56:59.645376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd126bd-46ec-4f05-afb1-dae554791ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:56:59.646064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd126bd-46ec-4f05-afb1-dae554791ade service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:56:59.646402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd126bd-46ec-4f05-afb1-dae554791ade service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:56:59.646869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd126bd-46ec-4f05-afb1-dae554791ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:56:59.649135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-efd126bd-46ec-4f05-afb1-dae554791ade service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:56:59.675234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:56:59.753380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd126bd-46ec-4f05-afb1-dae554791ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:56:59.755155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd126bd-46ec-4f05-afb1-dae554791ade service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:56:59.775428 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 683/1363] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:02.051694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e51fa4-e2c9-4298-81f6-0ca57bba2654 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:02.052223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e51fa4-e2c9-4298-81f6-0ca57bba2654 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:02.052558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e51fa4-e2c9-4298-81f6-0ca57bba2654 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:02.054179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 681/1364] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:02.059714 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015eb50-ca0b-4872-83cb-0696bb73bd57 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:02.060225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015eb50-ca0b-4872-83cb-0696bb73bd57 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:02.060313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015eb50-ca0b-4872-83cb-0696bb73bd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:02.131233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f015eb50-ca0b-4872-83cb-0696bb73bd57 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:02.132444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f015eb50-ca0b-4872-83cb-0696bb73bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:02.235236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:02.237973 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 684/1365] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:02.537546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69022ffd-645b-404c-987e-5d120c6935a1 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:02.537832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69022ffd-645b-404c-987e-5d120c6935a1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:02.538319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69022ffd-645b-404c-987e-5d120c6935a1 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:02.539665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 682/1366] 10.222.0.81 () {54 vars in 962 bytes} [Thu Aug 18 16:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:02.545254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27155a08-a2df-4d7a-81a3-8ac05eb4f2a0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:02.545616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27155a08-a2df-4d7a-81a3-8ac05eb4f2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:02.545968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27155a08-a2df-4d7a-81a3-8ac05eb4f2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:02.629709 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-27155a08-a2df-4d7a-81a3-8ac05eb4f2a0 None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:02.630945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-27155a08-a2df-4d7a-81a3-8ac05eb4f2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:02.764633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 685/1367] 10.222.0.81 () {58 vars in 1059 bytes} [Thu Aug 18 16:57:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:02.775059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69022ffd-645b-404c-987e-5d120c6935a1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:02.776622 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-69022ffd-645b-404c-987e-5d120c6935a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:02.947007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69022ffd-645b-404c-987e-5d120c6935a1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:02.969226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:03.070364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cef0d-801c-4283-acc2-f2f41e9274d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:03.071000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cef0d-801c-4283-acc2-f2f41e9274d9 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:03.071251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cef0d-801c-4283-acc2-f2f41e9274d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:03.071435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cef0d-801c-4283-acc2-f2f41e9274d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:03.073058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3c3cef0d-801c-4283-acc2-f2f41e9274d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:03.169446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cef0d-801c-4283-acc2-f2f41e9274d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:03.171102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cef0d-801c-4283-acc2-f2f41e9274d9 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:03.191565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 683/1368] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:03.749427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58e130-5a79-4bb7-8ba2-632688c97ee0 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:03.749928 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58e130-5a79-4bb7-8ba2-632688c97ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:03.750062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58e130-5a79-4bb7-8ba2-632688c97ee0 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:03.751487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 686/1369] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:03.757059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02363e4-9015-4b5f-a014-e24840e76b7a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:03.757346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02363e4-9015-4b5f-a014-e24840e76b7a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:03.757628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02363e4-9015-4b5f-a014-e24840e76b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:03.792953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:03.834504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a02363e4-9015-4b5f-a014-e24840e76b7a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:03.835875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a02363e4-9015-4b5f-a014-e24840e76b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:03.938577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 684/1370] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:04.520785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaea3b3-5c1d-4357-b3c2-0b534757bd5d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:04.520785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaea3b3-5c1d-4357-b3c2-0b534757bd5d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:04.520785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaea3b3-5c1d-4357-b3c2-0b534757bd5d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:04.523200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 687/1371] 10.222.0.81 () {54 vars in 964 bytes} [Thu Aug 18 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:04.526970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b270d-23d3-4331-8e6b-66e0bcbf5ba1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:04.527449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b270d-23d3-4331-8e6b-66e0bcbf5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:04.527721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b270d-23d3-4331-8e6b-66e0bcbf5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:04.609721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-537b270d-23d3-4331-8e6b-66e0bcbf5ba1 None None] MFA Rules not processed for user `2aa331983fbc4b18b7880084adcba3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:04.611074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-537b270d-23d3-4331-8e6b-66e0bcbf5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:04.662913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:04.696487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 685/1372] 10.222.0.81 () {58 vars in 1061 bytes} [Thu Aug 18 16:57:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:04.703999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaea3b3-5c1d-4357-b3c2-0b534757bd5d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:04.705677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-baaea3b3-5c1d-4357-b3c2-0b534757bd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:04.762148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:04.818898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaea3b3-5c1d-4357-b3c2-0b534757bd5d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:04.904564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df551022-5f48-42c7-a9ae-e5f540c345c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:04.905353 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551022-5f48-42c7-a9ae-e5f540c345c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:04.905741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551022-5f48-42c7-a9ae-e5f540c345c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:04.906124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551022-5f48-42c7-a9ae-e5f540c345c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:04.907911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-df551022-5f48-42c7-a9ae-e5f540c345c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:05.020206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:05.038028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df551022-5f48-42c7-a9ae-e5f540c345c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:05.039424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df551022-5f48-42c7-a9ae-e5f540c345c1 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:05.065999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 688/1373] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:05.173307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9e902-9625-42b4-b7dd-8f446f0689b5 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:05.174154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9e902-9625-42b4-b7dd-8f446f0689b5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:05.174825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9e902-9625-42b4-b7dd-8f446f0689b5 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:05.177964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 686/1374] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:05.183393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d08b3-1f96-443c-a9e4-b27efcc19cd3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:05.183951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d08b3-1f96-443c-a9e4-b27efcc19cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:05.184744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d08b3-1f96-443c-a9e4-b27efcc19cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:05.283380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c88d08b3-1f96-443c-a9e4-b27efcc19cd3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:05.284768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c88d08b3-1f96-443c-a9e4-b27efcc19cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:05.392708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 689/1375] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:05.677260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9e902-9625-42b4-b7dd-8f446f0689b5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:05.678891 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bdf9e902-9625-42b4-b7dd-8f446f0689b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:05.831660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9e902-9625-42b4-b7dd-8f446f0689b5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:05.888575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:05.956162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c0d18-34d9-4981-bd5a-1ec66804a027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:05.957379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0d18-34d9-4981-bd5a-1ec66804a027 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:05.957669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0d18-34d9-4981-bd5a-1ec66804a027 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:05.957942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0d18-34d9-4981-bd5a-1ec66804a027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:05.959564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-891c0d18-34d9-4981-bd5a-1ec66804a027 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:06.052064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c0d18-34d9-4981-bd5a-1ec66804a027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:06.053797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c0d18-34d9-4981-bd5a-1ec66804a027 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:06.072490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 687/1376] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:08.012211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29999bf-6816-44e7-ab0c-dc93c235a69f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:08.012744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29999bf-6816-44e7-ab0c-dc93c235a69f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:08.012744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29999bf-6816-44e7-ab0c-dc93c235a69f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:08.014138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 690/1377] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:08.019764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0b8e-836b-4812-8288-00f214f3d231 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:08.020250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0b8e-836b-4812-8288-00f214f3d231 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:08.020359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0b8e-836b-4812-8288-00f214f3d231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:08.100495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-458e0b8e-836b-4812-8288-00f214f3d231 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:08.103359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-458e0b8e-836b-4812-8288-00f214f3d231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:08.109465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:08.218440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 688/1378] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:08.535853 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29999bf-6816-44e7-ab0c-dc93c235a69f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:08.537615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c29999bf-6816-44e7-ab0c-dc93c235a69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:08.619259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:08.730955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29999bf-6816-44e7-ab0c-dc93c235a69f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:08.861091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36ca65-d7fe-4bd3-bc0f-d163b108a686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:08.861795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36ca65-d7fe-4bd3-bc0f-d163b108a686 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:08.862153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36ca65-d7fe-4bd3-bc0f-d163b108a686 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:08.862496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36ca65-d7fe-4bd3-bc0f-d163b108a686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:08.864261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fb36ca65-d7fe-4bd3-bc0f-d163b108a686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:08.884878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:08.962349 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36ca65-d7fe-4bd3-bc0f-d163b108a686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:08.963998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36ca65-d7fe-4bd3-bc0f-d163b108a686 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:08.983238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 691/1379] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:10.931877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247eee4-c802-4278-8320-2dec1dbb294c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:10.932361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247eee4-c802-4278-8320-2dec1dbb294c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:10.932361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247eee4-c802-4278-8320-2dec1dbb294c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:10.933812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 689/1380] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:10.941872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf450d1-8ae7-4d74-8204-0874284a8848 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:10.942380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf450d1-8ae7-4d74-8204-0874284a8848 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:10.942625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf450d1-8ae7-4d74-8204-0874284a8848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:11.015584 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-eaf450d1-8ae7-4d74-8204-0874284a8848 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:11.016897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-eaf450d1-8ae7-4d74-8204-0874284a8848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:11.118610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:11.125660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 692/1381] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:11.417933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247eee4-c802-4278-8320-2dec1dbb294c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:11.419551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e247eee4-c802-4278-8320-2dec1dbb294c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:11.572667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:11.584683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247eee4-c802-4278-8320-2dec1dbb294c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:11.706127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4ba2e-6454-4ad3-a3fd-990bb8417022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:11.707350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4ba2e-6454-4ad3-a3fd-990bb8417022 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:11.707648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4ba2e-6454-4ad3-a3fd-990bb8417022 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:11.707922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4ba2e-6454-4ad3-a3fd-990bb8417022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:11.709876 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f6f4ba2e-6454-4ad3-a3fd-990bb8417022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:11.815047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4ba2e-6454-4ad3-a3fd-990bb8417022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:11.819091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4ba2e-6454-4ad3-a3fd-990bb8417022 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:11.830309 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:11.840491 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 690/1382] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:57:13.786590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93704d6f-cce5-43f8-9bda-3aa60be9de65 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:13.787305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93704d6f-cce5-43f8-9bda-3aa60be9de65 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:13.787305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93704d6f-cce5-43f8-9bda-3aa60be9de65 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:13.788499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 693/1383] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:13.794852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a4f10-fa92-4500-a2db-3f9497558d6f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:13.795350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a4f10-fa92-4500-a2db-3f9497558d6f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:13.795452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a4f10-fa92-4500-a2db-3f9497558d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:13.872066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4d9a4f10-fa92-4500-a2db-3f9497558d6f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:13.873683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4d9a4f10-fa92-4500-a2db-3f9497558d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:13.994386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 691/1384] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:14.280402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93704d6f-cce5-43f8-9bda-3aa60be9de65 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:14.282052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-93704d6f-cce5-43f8-9bda-3aa60be9de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:14.447770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93704d6f-cce5-43f8-9bda-3aa60be9de65 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:14.525351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:14.574981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e41f65-b907-4a9f-a3f5-b52b27b697b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:14.575613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e41f65-b907-4a9f-a3f5-b52b27b697b9 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:14.575894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e41f65-b907-4a9f-a3f5-b52b27b697b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:14.576184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e41f65-b907-4a9f-a3f5-b52b27b697b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:14.577857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-13e41f65-b907-4a9f-a3f5-b52b27b697b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:14.678014 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e41f65-b907-4a9f-a3f5-b52b27b697b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:14.679720 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e41f65-b907-4a9f-a3f5-b52b27b697b9 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:14.699003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 694/1385] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:16.982827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a288d-34cd-406d-bf4c-05c014a3b586 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:16.983492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a288d-34cd-406d-bf4c-05c014a3b586 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:16.983492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a288d-34cd-406d-bf4c-05c014a3b586 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:16.984779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 692/1386] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:16.991027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3ba55-d363-468e-9627-f1eefe349e10 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:16.991498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3ba55-d363-468e-9627-f1eefe349e10 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:16.991747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3ba55-d363-468e-9627-f1eefe349e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:17.078180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a6b3ba55-d363-468e-9627-f1eefe349e10 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:17.079739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a6b3ba55-d363-468e-9627-f1eefe349e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:17.126182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:17.224086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 695/1387] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:17.511164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a288d-34cd-406d-bf4c-05c014a3b586 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:17.513240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-330a288d-34cd-406d-bf4c-05c014a3b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:17.613502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:17.686360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a288d-34cd-406d-bf4c-05c014a3b586 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:17.817063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3d610-047c-4faa-8dd6-66f870c93d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:17.817814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d610-047c-4faa-8dd6-66f870c93d01 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:17.818126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d610-047c-4faa-8dd6-66f870c93d01 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:17.818477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d610-047c-4faa-8dd6-66f870c93d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:17.820802 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-54e3d610-047c-4faa-8dd6-66f870c93d01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:17.869306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:17.926608 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3d610-047c-4faa-8dd6-66f870c93d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:17.928208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3d610-047c-4faa-8dd6-66f870c93d01 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:17.946692 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 693/1388] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:19.910795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6626f6e-bc7a-4954-9fe8-a109dd3f1d6c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:19.911360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6626f6e-bc7a-4954-9fe8-a109dd3f1d6c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:19.911360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6626f6e-bc7a-4954-9fe8-a109dd3f1d6c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:19.912751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 696/1389] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:19.917921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d0fd0-6319-400e-a26c-b9b4d77d894b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:19.918345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d0fd0-6319-400e-a26c-b9b4d77d894b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:19.918536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d0fd0-6319-400e-a26c-b9b4d77d894b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:19.986971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7b7d0fd0-6319-400e-a26c-b9b4d77d894b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:19.988730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7b7d0fd0-6319-400e-a26c-b9b4d77d894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:20.085514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 694/1390] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:20.088784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d54ca-a233-4f0a-87b1-fbaf5e4d206f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:20.089141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d54ca-a233-4f0a-87b1-fbaf5e4d206f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:20.089504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d54ca-a233-4f0a-87b1-fbaf5e4d206f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:20.090914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 697/1391] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:20.095998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e58ef-3f9c-4e64-9f25-e99590e818fb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:20.096289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e58ef-3f9c-4e64-9f25-e99590e818fb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:20.096613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e58ef-3f9c-4e64-9f25-e99590e818fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:20.112540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:20.164798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-770e58ef-3f9c-4e64-9f25-e99590e818fb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:20.166046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-770e58ef-3f9c-4e64-9f25-e99590e818fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:20.264609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 695/1392] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:20.377140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d54ca-a233-4f0a-87b1-fbaf5e4d206f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:20.378818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-853d54ca-a233-4f0a-87b1-fbaf5e4d206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:20.560844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278e1b-f729-4ed7-8d87-2e51400bfac0 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:20.561135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278e1b-f729-4ed7-8d87-2e51400bfac0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:20.561414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278e1b-f729-4ed7-8d87-2e51400bfac0 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:20.562758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 696/1393] 10.222.0.81 () {54 vars in 967 bytes} [Thu Aug 18 16:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:57:20.568707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd48a42-d6e3-4591-9d6b-6f06f68960c3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:20.568993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd48a42-d6e3-4591-9d6b-6f06f68960c3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:20.569270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd48a42-d6e3-4591-9d6b-6f06f68960c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:20.645335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1cd48a42-d6e3-4591-9d6b-6f06f68960c3 None None] MFA Rules not processed for user `a710cfeadd004a8bbf932f6bb3b211e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:20.646254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1cd48a42-d6e3-4591-9d6b-6f06f68960c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:20.650035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d54ca-a233-4f0a-87b1-fbaf5e4d206f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:20.666758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:20.682651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:20.727919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 697/1394] 10.222.0.81 () {58 vars in 1064 bytes} [Thu Aug 18 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:57:20.739109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd48a42-d6e3-4591-9d6b-6f06f68960c3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:20.746159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd48a42-d6e3-4591-9d6b-6f06f68960c3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:20.772968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf5473-ffc1-4e8d-8f48-ed884a57bcba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:20.773685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf5473-ffc1-4e8d-8f48-ed884a57bcba service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:20.774106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf5473-ffc1-4e8d-8f48-ed884a57bcba service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:20.774384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf5473-ffc1-4e8d-8f48-ed884a57bcba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:20.775985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0eaf5473-ffc1-4e8d-8f48-ed884a57bcba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:20.821319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c62c4-c3c4-43ff-b47f-b11d5ad6f768 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a710cfeadd004a8bbf932f6bb3b211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:20.821931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c62c4-c3c4-43ff-b47f-b11d5ad6f768 service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:20.822212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c62c4-c3c4-43ff-b47f-b11d5ad6f768 service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:20.822481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c62c4-c3c4-43ff-b47f-b11d5ad6f768 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:20.824080 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d53c62c4-c3c4-43ff-b47f-b11d5ad6f768 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:20.868106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf5473-ffc1-4e8d-8f48-ed884a57bcba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:20.869735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf5473-ffc1-4e8d-8f48-ed884a57bcba service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:20.888145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 698/1395] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:20.934897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:20.939672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c62c4-c3c4-43ff-b47f-b11d5ad6f768 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:20.940973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c62c4-c3c4-43ff-b47f-b11d5ad6f768 service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:20.962908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 698/1396] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:57:21.698224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1345379-125b-4f9b-b267-fd1f4f24b758 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:21.698711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1345379-125b-4f9b-b267-fd1f4f24b758 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:21.698886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1345379-125b-4f9b-b267-fd1f4f24b758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:21.728793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:21.773448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e1345379-125b-4f9b-b267-fd1f4f24b758 None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:21.774665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e1345379-125b-4f9b-b267-fd1f4f24b758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:21.863626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 699/1397] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 16:57:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:21.905839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d599-a12a-4a5d-ab7f-959ff0c364fb None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:21.906205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d599-a12a-4a5d-ab7f-959ff0c364fb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:21.906553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9d599-a12a-4a5d-ab7f-959ff0c364fb None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:21.907991 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 699/1398] 10.222.0.81 () {54 vars in 943 bytes} [Thu Aug 18 16:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:21.915375 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e79166-ee3d-4dba-8f3d-dc3f04c72c8d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:21.915733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e79166-ee3d-4dba-8f3d-dc3f04c72c8d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:21.916078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e79166-ee3d-4dba-8f3d-dc3f04c72c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:21.996894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-93e79166-ee3d-4dba-8f3d-dc3f04c72c8d None None] MFA Rules not processed for user `4ee382ab3c8945f1b39b14b00d9237ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:21.997938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-93e79166-ee3d-4dba-8f3d-dc3f04c72c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:22.055123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:22.112840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 700/1399] 10.222.0.81 () {58 vars in 1040 bytes} [Thu Aug 18 16:57:21 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:22.122856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d599-a12a-4a5d-ab7f-959ff0c364fb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:22.124353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1fa9d599-a12a-4a5d-ab7f-959ff0c364fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:22.259077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9d599-a12a-4a5d-ab7f-959ff0c364fb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:22.328986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:22.371141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b5d11-dd55-419d-856d-6223aa4fe55e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:22.371789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b5d11-dd55-419d-856d-6223aa4fe55e service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:22.372071 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b5d11-dd55-419d-856d-6223aa4fe55e service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:22.372347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b5d11-dd55-419d-856d-6223aa4fe55e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:22.374055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-674b5d11-dd55-419d-856d-6223aa4fe55e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:22.463903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b5d11-dd55-419d-856d-6223aa4fe55e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:22.465831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b5d11-dd55-419d-856d-6223aa4fe55e service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:22.474610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 700/1400] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 16:57:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 16:57:22.836689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770dd68-670a-4a80-9251-8c4b47693e6d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:22.837217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770dd68-670a-4a80-9251-8c4b47693e6d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:22.837217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770dd68-670a-4a80-9251-8c4b47693e6d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:22.838484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 701/1401] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:22.850041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9ad6-3a0f-4ec2-b62c-513d64266202 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:22.850041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9ad6-3a0f-4ec2-b62c-513d64266202 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:22.850041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9ad6-3a0f-4ec2-b62c-513d64266202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:22.926953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-440c9ad6-3a0f-4ec2-b62c-513d64266202 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:22.928168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-440c9ad6-3a0f-4ec2-b62c-513d64266202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:22.995861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:23.044532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 701/1402] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:23.334896 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770dd68-670a-4a80-9251-8c4b47693e6d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:23.336730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0770dd68-670a-4a80-9251-8c4b47693e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:23.495623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770dd68-670a-4a80-9251-8c4b47693e6d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:23.524292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:23.633820 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e40f21-eb6c-4e39-bbeb-209340bd3370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:23.634357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e40f21-eb6c-4e39-bbeb-209340bd3370 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:23.634637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e40f21-eb6c-4e39-bbeb-209340bd3370 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:23.634938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e40f21-eb6c-4e39-bbeb-209340bd3370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:23.636561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a3e40f21-eb6c-4e39-bbeb-209340bd3370 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:23.744534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e40f21-eb6c-4e39-bbeb-209340bd3370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:23.746223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e40f21-eb6c-4e39-bbeb-209340bd3370 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:23.767332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 702/1403] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:25.750612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e3fc2-3ead-4815-9b50-7c9b342d599c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:25.751102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e3fc2-3ead-4815-9b50-7c9b342d599c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:25.751209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e3fc2-3ead-4815-9b50-7c9b342d599c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:25.756107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 702/1404] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:25.758002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c135ea-8ee9-43f9-bd67-e692c2be85de None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:25.758455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c135ea-8ee9-43f9-bd67-e692c2be85de None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:25.759067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c135ea-8ee9-43f9-bd67-e692c2be85de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:25.802126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:25.835708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-27c135ea-8ee9-43f9-bd67-e692c2be85de None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:25.837659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-27c135ea-8ee9-43f9-bd67-e692c2be85de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:25.960272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 703/1405] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:26.267277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e3fc2-3ead-4815-9b50-7c9b342d599c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:26.268856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-876e3fc2-3ead-4815-9b50-7c9b342d599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:26.438073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e3fc2-3ead-4815-9b50-7c9b342d599c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:26.489716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:26.568666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73de99d-a052-4831-aba9-1be34219ca28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:26.569589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73de99d-a052-4831-aba9-1be34219ca28 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:26.570023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73de99d-a052-4831-aba9-1be34219ca28 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:26.570459 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73de99d-a052-4831-aba9-1be34219ca28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:26.572549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a73de99d-a052-4831-aba9-1be34219ca28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:26.674959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73de99d-a052-4831-aba9-1be34219ca28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:26.676638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73de99d-a052-4831-aba9-1be34219ca28 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:26.697215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 703/1406] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:28.657402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef7e9-fb71-4144-85ca-4dee70c8432b None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:28.658037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef7e9-fb71-4144-85ca-4dee70c8432b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:28.658037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eef7e9-fb71-4144-85ca-4dee70c8432b None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:28.664850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 704/1407] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:57:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:28.665014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d20b-75d6-4200-b4f3-8ac93ab4df93 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:28.665014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d20b-75d6-4200-b4f3-8ac93ab4df93 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:28.665588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d20b-75d6-4200-b4f3-8ac93ab4df93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:28.745243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:28.755326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3179d20b-75d6-4200-b4f3-8ac93ab4df93 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:28.756954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3179d20b-75d6-4200-b4f3-8ac93ab4df93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:28.869981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 704/1408] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:57:29.168208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eef7e9-fb71-4144-85ca-4dee70c8432b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:29.169766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-53eef7e9-fb71-4144-85ca-4dee70c8432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:29.291842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:29.337226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eef7e9-fb71-4144-85ca-4dee70c8432b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:29.468020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe91b28-dac5-46d0-8c7a-58da7a20c123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:29.468711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe91b28-dac5-46d0-8c7a-58da7a20c123 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:29.468990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe91b28-dac5-46d0-8c7a-58da7a20c123 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:29.469268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe91b28-dac5-46d0-8c7a-58da7a20c123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:29.471191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6fe91b28-dac5-46d0-8c7a-58da7a20c123 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:29.557060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:29.578354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe91b28-dac5-46d0-8c7a-58da7a20c123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:29.580064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe91b28-dac5-46d0-8c7a-58da7a20c123 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:29.599072 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 705/1409] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:38.868767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=44 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:39.596745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=14 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:44.468637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342a5e-f74f-4a61-838a-2bc0d075d68b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:44.469242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342a5e-f74f-4a61-838a-2bc0d075d68b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:44.469242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342a5e-f74f-4a61-838a-2bc0d075d68b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:44.470631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 705/1410] 10.222.0.81 () {54 vars in 918 bytes} [Thu Aug 18 16:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:44.476392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5bd0-7bc8-4d8b-8406-7bd0b421d4dc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:44.476860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5bd0-7bc8-4d8b-8406-7bd0b421d4dc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:44.476966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5bd0-7bc8-4d8b-8406-7bd0b421d4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:44.554581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-128d5bd0-7bc8-4d8b-8406-7bd0b421d4dc None None] MFA Rules not processed for user `4cc1ad7e47454b5d9d2ef2190414010c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:44.555795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-128d5bd0-7bc8-4d8b-8406-7bd0b421d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:44.661044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 706/1411] 10.222.0.81 () {58 vars in 1015 bytes} [Thu Aug 18 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:44.675206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c7f0d-db7f-4446-9b95-d84a9d3bbb99 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:44.676056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c7f0d-db7f-4446-9b95-d84a9d3bbb99 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:44.676337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c7f0d-db7f-4446-9b95-d84a9d3bbb99 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:44.678882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 706/1412] 10.222.0.81 () {54 vars in 918 bytes} [Thu Aug 18 16:57:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:44.683810 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c008c1-ddb0-4023-b776-86ae00416cd8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:44.684094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c008c1-ddb0-4023-b776-86ae00416cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:44.684374 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c008c1-ddb0-4023-b776-86ae00416cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:44.757537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:44.760058 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-52c008c1-ddb0-4023-b776-86ae00416cd8 None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:44.762011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-52c008c1-ddb0-4023-b776-86ae00416cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:44.878230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 707/1413] 10.222.0.81 () {58 vars in 1015 bytes} [Thu Aug 18 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:57:47.255081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b2acb-90c1-4b4c-b032-bda84a5b9c03 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:47.255624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b2acb-90c1-4b4c-b032-bda84a5b9c03 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:47.255624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b2acb-90c1-4b4c-b032-bda84a5b9c03 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:47.257043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:47.262225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff039b8-6ad8-4cb4-9e8b-7f7484b0bbb1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:47.262710 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff039b8-6ad8-4cb4-9e8b-7f7484b0bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:47.262820 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff039b8-6ad8-4cb4-9e8b-7f7484b0bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:47.329295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-dff039b8-6ad8-4cb4-9e8b-7f7484b0bbb1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:47.330509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dff039b8-6ad8-4cb4-9e8b-7f7484b0bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:47.386559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:47.428914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:57:47.715320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b2acb-90c1-4b4c-b032-bda84a5b9c03 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:47.716876 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-576b2acb-90c1-4b4c-b032-bda84a5b9c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:47.861530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b2acb-90c1-4b4c-b032-bda84a5b9c03 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:47.932562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:47.973246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35689b-9e3d-4152-bd97-0054c1373b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:47.973780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35689b-9e3d-4152-bd97-0054c1373b9c service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:47.974061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35689b-9e3d-4152-bd97-0054c1373b9c service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:47.974340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35689b-9e3d-4152-bd97-0054c1373b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:47.975960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ef35689b-9e3d-4152-bd97-0054c1373b9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:48.064282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35689b-9e3d-4152-bd97-0054c1373b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:48.066803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35689b-9e3d-4152-bd97-0054c1373b9c service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:48.088273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 708/1416] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:48.981184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1157ad-a048-41c6-b72b-00d06d76a91c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:48.981744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1157ad-a048-41c6-b72b-00d06d76a91c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:48.981744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1157ad-a048-41c6-b72b-00d06d76a91c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:48.983339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:48.988732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b36091-a970-4f2a-a7f2-275c57aa22bf None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:48.989170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b36091-a970-4f2a-a7f2-275c57aa22bf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:48.989281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b36091-a970-4f2a-a7f2-275c57aa22bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:49.068194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e9b36091-a970-4f2a-a7f2-275c57aa22bf None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:49.069429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e9b36091-a970-4f2a-a7f2-275c57aa22bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:49.095719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:49.166558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:49.315649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1157ad-a048-41c6-b72b-00d06d76a91c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:49.317650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ed1157ad-a048-41c6-b72b-00d06d76a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:49.462736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1157ad-a048-41c6-b72b-00d06d76a91c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:49.502318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:49.575434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486dcb3-1f9f-48a4-a42b-8aca67e37c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:49.575955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486dcb3-1f9f-48a4-a42b-8aca67e37c35 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:49.576263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486dcb3-1f9f-48a4-a42b-8aca67e37c35 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:49.576617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486dcb3-1f9f-48a4-a42b-8aca67e37c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:49.578207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0486dcb3-1f9f-48a4-a42b-8aca67e37c35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:49.666066 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486dcb3-1f9f-48a4-a42b-8aca67e37c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:49.667650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486dcb3-1f9f-48a4-a42b-8aca67e37c35 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:49.685883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 710/1419] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:50.568482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79082fb-59f1-4561-831f-08df9d0327e0 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:50.569030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79082fb-59f1-4561-831f-08df9d0327e0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:50.569030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79082fb-59f1-4561-831f-08df9d0327e0 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:50.570408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:50.575418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef3d6e-9e49-4f4a-b613-0189b17608ee None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:50.575841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef3d6e-9e49-4f4a-b613-0189b17608ee None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:50.576002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef3d6e-9e49-4f4a-b613-0189b17608ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:50.632645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:50.654773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1eef3d6e-9e49-4f4a-b613-0189b17608ee None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:50.655971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1eef3d6e-9e49-4f4a-b613-0189b17608ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:50.752050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:50.903685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79082fb-59f1-4561-831f-08df9d0327e0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:50.905260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a79082fb-59f1-4561-831f-08df9d0327e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:51.047469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79082fb-59f1-4561-831f-08df9d0327e0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:51.059824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:51.159347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9cb87-ca6b-47e1-899e-f81302a87da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:51.160378 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9cb87-ca6b-47e1-899e-f81302a87da3 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:51.160681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9cb87-ca6b-47e1-899e-f81302a87da3 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:51.160952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9cb87-ca6b-47e1-899e-f81302a87da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:51.162532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-17e9cb87-ca6b-47e1-899e-f81302a87da3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:51.251133 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9cb87-ca6b-47e1-899e-f81302a87da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:51.252747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9cb87-ca6b-47e1-899e-f81302a87da3 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:51.270865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 711/1422] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:52.133190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5390e-2c65-4b21-a29d-9d1b06d3f452 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:52.133877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5390e-2c65-4b21-a29d-9d1b06d3f452 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:52.133877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5390e-2c65-4b21-a29d-9d1b06d3f452 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:52.135067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:52.140135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9a19-bed5-4d3e-a7fb-53ff6f5561be None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:52.140554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9a19-bed5-4d3e-a7fb-53ff6f5561be None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:52.140709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9a19-bed5-4d3e-a7fb-53ff6f5561be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:52.159911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:52.334792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-994f9a19-bed5-4d3e-a7fb-53ff6f5561be None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:52.336028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-994f9a19-bed5-4d3e-a7fb-53ff6f5561be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:52.433136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:52.585449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5390e-2c65-4b21-a29d-9d1b06d3f452 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:52.587027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5db5390e-2c65-4b21-a29d-9d1b06d3f452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:52.696165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:52.733505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5390e-2c65-4b21-a29d-9d1b06d3f452 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:52.845557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a1e88-489b-4f6a-a2a3-eaccb118068e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:52.846164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a1e88-489b-4f6a-a2a3-eaccb118068e service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:52.846448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a1e88-489b-4f6a-a2a3-eaccb118068e service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:52.846715 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a1e88-489b-4f6a-a2a3-eaccb118068e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:52.848907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cb4a1e88-489b-4f6a-a2a3-eaccb118068e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:52.926123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:52.939873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a1e88-489b-4f6a-a2a3-eaccb118068e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:52.942060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a1e88-489b-4f6a-a2a3-eaccb118068e service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:52.959705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 713/1425] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:53.826038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea1ac-0538-4e5b-a5d7-1d1acc5b421c None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:53.826605 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea1ac-0538-4e5b-a5d7-1d1acc5b421c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:53.826731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cea1ac-0538-4e5b-a5d7-1d1acc5b421c None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:53.828091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:53.833732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb296e55-fb30-470e-a7ff-8e95a51b0b44 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:53.834135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb296e55-fb30-470e-a7ff-8e95a51b0b44 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:53.834294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb296e55-fb30-470e-a7ff-8e95a51b0b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:53.911037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fb296e55-fb30-470e-a7ff-8e95a51b0b44 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:53.912248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fb296e55-fb30-470e-a7ff-8e95a51b0b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:54.008149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:57:54.158637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cea1ac-0538-4e5b-a5d7-1d1acc5b421c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:54.160198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c8cea1ac-0538-4e5b-a5d7-1d1acc5b421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:54.243107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:54.305371 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cea1ac-0538-4e5b-a5d7-1d1acc5b421c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:54.416796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1943f18-e905-40fd-b3e7-80410343aac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:54.417405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1943f18-e905-40fd-b3e7-80410343aac1 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:54.417689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1943f18-e905-40fd-b3e7-80410343aac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:54.417962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1943f18-e905-40fd-b3e7-80410343aac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:54.419554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f1943f18-e905-40fd-b3e7-80410343aac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:54.470104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:54.512385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1943f18-e905-40fd-b3e7-80410343aac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:54.514005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1943f18-e905-40fd-b3e7-80410343aac1 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:54.532655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 714/1428] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:55.333675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ad0e-c5cb-42e1-915a-d1fb002aa91a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:55.334281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ad0e-c5cb-42e1-915a-d1fb002aa91a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:55.334281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ad0e-c5cb-42e1-915a-d1fb002aa91a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:55.335562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:55.340709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b008a-b40d-4b8c-a399-0066f945fab7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:55.341164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b008a-b40d-4b8c-a399-0066f945fab7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:55.341284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b008a-b40d-4b8c-a399-0066f945fab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:55.418382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-497b008a-b40d-4b8c-a399-0066f945fab7 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:55.419587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-497b008a-b40d-4b8c-a399-0066f945fab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:55.522972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:55.671431 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70ad0e-c5cb-42e1-915a-d1fb002aa91a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:55.673004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a70ad0e-c5cb-42e1-915a-d1fb002aa91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:55.727323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:55.827401 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70ad0e-c5cb-42e1-915a-d1fb002aa91a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:55.943384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dfa22-7458-4145-bbe3-8475110c439d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:55.943908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dfa22-7458-4145-bbe3-8475110c439d service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:55.944185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dfa22-7458-4145-bbe3-8475110c439d service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:55.944475 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dfa22-7458-4145-bbe3-8475110c439d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:55.946071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-803dfa22-7458-4145-bbe3-8475110c439d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:55.953206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:56.037288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dfa22-7458-4145-bbe3-8475110c439d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:56.038883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dfa22-7458-4145-bbe3-8475110c439d service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:56.057456 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 716/1431] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:56.863221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36228756-482d-4fb5-9ed7-bb5ee29a0654 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:56.863786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36228756-482d-4fb5-9ed7-bb5ee29a0654 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:56.863786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36228756-482d-4fb5-9ed7-bb5ee29a0654 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:56.865143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:56.869987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2976f-b985-44ac-9052-8703c8f9783c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:56.870417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2976f-b985-44ac-9052-8703c8f9783c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:56.870537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2976f-b985-44ac-9052-8703c8f9783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:56.948360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bcf2976f-b985-44ac-9052-8703c8f9783c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:56.949591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bcf2976f-b985-44ac-9052-8703c8f9783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:57.018159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:57.048988 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:57.198007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36228756-482d-4fb5-9ed7-bb5ee29a0654 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:57.199511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-36228756-482d-4fb5-9ed7-bb5ee29a0654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:57.217374 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:57.342546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36228756-482d-4fb5-9ed7-bb5ee29a0654 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:57.428864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:57.454921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbb59e-9a8d-4f85-9a65-b23adfacddac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:57.455530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbb59e-9a8d-4f85-9a65-b23adfacddac service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:57.455808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbb59e-9a8d-4f85-9a65-b23adfacddac service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:57.456080 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbb59e-9a8d-4f85-9a65-b23adfacddac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:57.457737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-08dbb59e-9a8d-4f85-9a65-b23adfacddac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:57.547597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbb59e-9a8d-4f85-9a65-b23adfacddac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:57.549453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbb59e-9a8d-4f85-9a65-b23adfacddac service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:57.568922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 717/1434] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:58.367301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978823-9d76-46c6-a549-932750c55c9a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:58.367838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978823-9d76-46c6-a549-932750c55c9a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:58.367948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95978823-9d76-46c6-a549-932750c55c9a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:58.369258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:58.374192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d57a14-ce00-4185-88fe-d5247190260c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:58.374625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d57a14-ce00-4185-88fe-d5247190260c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:58.374731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d57a14-ce00-4185-88fe-d5247190260c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:58.449883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-92d57a14-ce00-4185-88fe-d5247190260c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:58.451077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-92d57a14-ce00-4185-88fe-d5247190260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:58.493647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:58.548112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:57:58.698516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978823-9d76-46c6-a549-932750c55c9a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:57:58.700001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-95978823-9d76-46c6-a549-932750c55c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:58.845548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95978823-9d76-46c6-a549-932750c55c9a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:57:58.899734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:57:58.960612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d7db-c1ea-47b0-a1f9-7a65fd11ec70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:57:58.961166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d7db-c1ea-47b0-a1f9-7a65fd11ec70 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:58.961451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d7db-c1ea-47b0-a1f9-7a65fd11ec70 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:58.961723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d7db-c1ea-47b0-a1f9-7a65fd11ec70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:58.963360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-22a5d7db-c1ea-47b0-a1f9-7a65fd11ec70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:59.054511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d7db-c1ea-47b0-a1f9-7a65fd11ec70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:57:59.056121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d7db-c1ea-47b0-a1f9-7a65fd11ec70 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:57:59.074420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 719/1437] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:57:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:57:59.870193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302f0e7-8416-4df7-97fd-428df6005bc8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:59.870764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302f0e7-8416-4df7-97fd-428df6005bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:59.870764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302f0e7-8416-4df7-97fd-428df6005bc8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:59.872076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 16:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:57:59.877016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfa80c-14e4-409f-8dda-f8e5256cdbbd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:57:59.877497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfa80c-14e4-409f-8dda-f8e5256cdbbd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:57:59.877604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfa80c-14e4-409f-8dda-f8e5256cdbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:57:59.961716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-74cfa80c-14e4-409f-8dda-f8e5256cdbbd None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:57:59.962926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-74cfa80c-14e4-409f-8dda-f8e5256cdbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:57:59.964945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:00.068068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 16:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:00.221216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302f0e7-8416-4df7-97fd-428df6005bc8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:00.223380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5302f0e7-8416-4df7-97fd-428df6005bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:00.380154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302f0e7-8416-4df7-97fd-428df6005bc8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:00.427969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:00.532752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3d620-86bd-431b-92ac-02881c1b95c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:00.533385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d620-86bd-431b-92ac-02881c1b95c4 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:00.533662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d620-86bd-431b-92ac-02881c1b95c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:00.533934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d620-86bd-431b-92ac-02881c1b95c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:00.536208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4bc3d620-86bd-431b-92ac-02881c1b95c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:00.642681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3d620-86bd-431b-92ac-02881c1b95c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:00.644877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3d620-86bd-431b-92ac-02881c1b95c4 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:00.662795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 720/1440] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:02.485929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a68cc-23df-443e-8682-b1cfbd1db977 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:02.486481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a68cc-23df-443e-8682-b1cfbd1db977 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:02.486481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a68cc-23df-443e-8682-b1cfbd1db977 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:02.487908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:02.493258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76cc2e-d3d0-45a0-9bc0-8b7044b1d8a6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:02.493685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76cc2e-d3d0-45a0-9bc0-8b7044b1d8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:02.493805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76cc2e-d3d0-45a0-9bc0-8b7044b1d8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:02.537879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:02.564035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cf76cc2e-d3d0-45a0-9bc0-8b7044b1d8a6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:02.565276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cf76cc2e-d3d0-45a0-9bc0-8b7044b1d8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:02.661238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:02.949160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a68cc-23df-443e-8682-b1cfbd1db977 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:02.950694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4f9a68cc-23df-443e-8682-b1cfbd1db977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:03.054644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a68cc-23df-443e-8682-b1cfbd1db977 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:03.087194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:03.127856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c27324-9e32-476d-b995-a9919e009954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:03.129019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c27324-9e32-476d-b995-a9919e009954 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:03.129298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c27324-9e32-476d-b995-a9919e009954 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:03.129572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c27324-9e32-476d-b995-a9919e009954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:03.131163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-74c27324-9e32-476d-b995-a9919e009954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:03.239010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c27324-9e32-476d-b995-a9919e009954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:03.240428 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c27324-9e32-476d-b995-a9919e009954 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:03.259140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 722/1443] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:05.489740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627a34c-b60f-486d-8f0b-8fdee9ae4346 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:05.490365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627a34c-b60f-486d-8f0b-8fdee9ae4346 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:05.490484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627a34c-b60f-486d-8f0b-8fdee9ae4346 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:05.491747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:05.497342 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eccb1-7086-4d66-9473-b8af39dd804c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:05.497918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eccb1-7086-4d66-9473-b8af39dd804c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:05.498095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eccb1-7086-4d66-9473-b8af39dd804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:05.585051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e26eccb1-7086-4d66-9473-b8af39dd804c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:05.586947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e26eccb1-7086-4d66-9473-b8af39dd804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:05.602559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:05.704126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:06.019673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627a34c-b60f-486d-8f0b-8fdee9ae4346 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:06.021088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0627a34c-b60f-486d-8f0b-8fdee9ae4346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:06.142370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627a34c-b60f-486d-8f0b-8fdee9ae4346 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:06.156308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:06.230428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4d15c-61e1-427f-a19c-a6f435e246ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:06.231052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4d15c-61e1-427f-a19c-a6f435e246ab service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:06.231330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4d15c-61e1-427f-a19c-a6f435e246ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:06.231587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4d15c-61e1-427f-a19c-a6f435e246ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:06.233942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9ac4d15c-61e1-427f-a19c-a6f435e246ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:06.376824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4d15c-61e1-427f-a19c-a6f435e246ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:06.379314 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4d15c-61e1-427f-a19c-a6f435e246ab service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:06.399433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 723/1446] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:08.729808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553be5ca-60c7-415d-b9e4-6eedcb703834 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:08.730716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553be5ca-60c7-415d-b9e4-6eedcb703834 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:08.730716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553be5ca-60c7-415d-b9e4-6eedcb703834 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:08.732690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:08.738831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153fbf0-a5fb-438e-8ef9-a3513a6d6f98 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:08.739370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153fbf0-a5fb-438e-8ef9-a3513a6d6f98 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:08.739467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153fbf0-a5fb-438e-8ef9-a3513a6d6f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:08.794761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:08.824946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9153fbf0-a5fb-438e-8ef9-a3513a6d6f98 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:08.826184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9153fbf0-a5fb-438e-8ef9-a3513a6d6f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:08.954760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:09.249306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553be5ca-60c7-415d-b9e4-6eedcb703834 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:09.250883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-553be5ca-60c7-415d-b9e4-6eedcb703834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:09.366922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553be5ca-60c7-415d-b9e4-6eedcb703834 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:09.409788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:09.456523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7007e-d37a-4f32-8907-14f7ead0eae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:09.457158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7007e-d37a-4f32-8907-14f7ead0eae8 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:09.457441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7007e-d37a-4f32-8907-14f7ead0eae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:09.457716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7007e-d37a-4f32-8907-14f7ead0eae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:09.459415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1ef7007e-d37a-4f32-8907-14f7ead0eae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:09.607183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7007e-d37a-4f32-8907-14f7ead0eae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:09.608864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7007e-d37a-4f32-8907-14f7ead0eae8 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:09.630086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 725/1449] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:11.750743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c49f8-9dc7-4df3-9017-2be40ae5e2af None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:11.751322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c49f8-9dc7-4df3-9017-2be40ae5e2af None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:11.751322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c49f8-9dc7-4df3-9017-2be40ae5e2af None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:11.752751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:11.758869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b225d-1f6f-4f01-8534-6f1d221dba7b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:11.759416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b225d-1f6f-4f01-8534-6f1d221dba7b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:11.759496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b225d-1f6f-4f01-8534-6f1d221dba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:11.849043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f38b225d-1f6f-4f01-8534-6f1d221dba7b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:11.851079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f38b225d-1f6f-4f01-8534-6f1d221dba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:11.874741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:11.961382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:12.341799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c49f8-9dc7-4df3-9017-2be40ae5e2af None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:12.343367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-460c49f8-9dc7-4df3-9017-2be40ae5e2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:12.455012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c49f8-9dc7-4df3-9017-2be40ae5e2af None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:12.476775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:12.536401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c669c3-2487-4725-9b34-d54b776c1bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:12.537053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c669c3-2487-4725-9b34-d54b776c1bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:12.537337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c669c3-2487-4725-9b34-d54b776c1bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:12.537614 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c669c3-2487-4725-9b34-d54b776c1bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:12.539308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b1c669c3-2487-4725-9b34-d54b776c1bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:12.660983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c669c3-2487-4725-9b34-d54b776c1bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:12.662336 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c669c3-2487-4725-9b34-d54b776c1bd4 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:12.681313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 726/1452] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:14.763077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a44c7-46e0-4116-bee2-2bda34937c5f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:14.763659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a44c7-46e0-4116-bee2-2bda34937c5f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:14.763659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a44c7-46e0-4116-bee2-2bda34937c5f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:14.765033 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:14.771447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9697649-3523-4c47-9ce0-d7aaef892388 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:14.771954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9697649-3523-4c47-9ce0-d7aaef892388 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:14.772049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9697649-3523-4c47-9ce0-d7aaef892388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:14.841026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:14.845965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c9697649-3523-4c47-9ce0-d7aaef892388 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:14.847577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c9697649-3523-4c47-9ce0-d7aaef892388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:14.965293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:15.261566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a44c7-46e0-4116-bee2-2bda34937c5f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:15.263198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-409a44c7-46e0-4116-bee2-2bda34937c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:15.386858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a44c7-46e0-4116-bee2-2bda34937c5f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:15.451683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:15.481848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bbaa7-56f2-4eb2-90e8-56e73f3a6d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:15.482757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bbaa7-56f2-4eb2-90e8-56e73f3a6d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:15.483039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bbaa7-56f2-4eb2-90e8-56e73f3a6d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:15.483311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bbaa7-56f2-4eb2-90e8-56e73f3a6d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:15.485065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-035bbaa7-56f2-4eb2-90e8-56e73f3a6d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:15.637551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bbaa7-56f2-4eb2-90e8-56e73f3a6d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:15.638934 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bbaa7-56f2-4eb2-90e8-56e73f3a6d79 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:15.661083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 728/1455] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 16:58:17.728965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771062e7-dd98-44a3-8feb-092f71d48b68 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:17.729644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771062e7-dd98-44a3-8feb-092f71d48b68 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:17.729644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771062e7-dd98-44a3-8feb-092f71d48b68 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:17.730754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:17.737466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfe02-ae03-4e69-8a9b-fd6c791c3daa None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:17.738253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfe02-ae03-4e69-8a9b-fd6c791c3daa None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:17.738432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfe02-ae03-4e69-8a9b-fd6c791c3daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:17.811911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-577bfe02-ae03-4e69-8a9b-fd6c791c3daa None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:17.813183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-577bfe02-ae03-4e69-8a9b-fd6c791c3daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:17.847352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:17.937141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:58:18.226729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771062e7-dd98-44a3-8feb-092f71d48b68 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:18.228273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-771062e7-dd98-44a3-8feb-092f71d48b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:18.345198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771062e7-dd98-44a3-8feb-092f71d48b68 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:18.378868 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:18.429707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cb95a-0ad8-4fe9-96a7-4d34343aa3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:18.430334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb95a-0ad8-4fe9-96a7-4d34343aa3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:18.430617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb95a-0ad8-4fe9-96a7-4d34343aa3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:18.430892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cb95a-0ad8-4fe9-96a7-4d34343aa3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:18.433026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-aa5cb95a-0ad8-4fe9-96a7-4d34343aa3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:18.550375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cb95a-0ad8-4fe9-96a7-4d34343aa3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:18.552044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cb95a-0ad8-4fe9-96a7-4d34343aa3d4 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:18.572281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 729/1458] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:20.660886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e1977-b670-4f18-bb85-f61e8c58811a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:20.661480 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e1977-b670-4f18-bb85-f61e8c58811a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:20.661480 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e1977-b670-4f18-bb85-f61e8c58811a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:20.662815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:58:20.668983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60825443-31d8-43f9-93fc-a4f6760a4f25 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:20.669586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60825443-31d8-43f9-93fc-a4f6760a4f25 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:20.669586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60825443-31d8-43f9-93fc-a4f6760a4f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:20.743647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-60825443-31d8-43f9-93fc-a4f6760a4f25 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:20.745132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-60825443-31d8-43f9-93fc-a4f6760a4f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:20.755879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:20.858392 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:21.141032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e1977-b670-4f18-bb85-f61e8c58811a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:21.142585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2e4e1977-b670-4f18-bb85-f61e8c58811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:21.263011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e1977-b670-4f18-bb85-f61e8c58811a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:21.328555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:21.351092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd3eb4-e779-4d02-a2d4-d6dc9ba15cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:21.351717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3eb4-e779-4d02-a2d4-d6dc9ba15cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:21.351997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3eb4-e779-4d02-a2d4-d6dc9ba15cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:21.352267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3eb4-e779-4d02-a2d4-d6dc9ba15cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:21.353970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-76bd3eb4-e779-4d02-a2d4-d6dc9ba15cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:21.475893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd3eb4-e779-4d02-a2d4-d6dc9ba15cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:21.477390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd3eb4-e779-4d02-a2d4-d6dc9ba15cc6 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:21.498107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 731/1461] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:23.557399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477201-a40a-4db9-b330-2f7b061f34c8 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:23.557987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477201-a40a-4db9-b330-2f7b061f34c8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:23.557987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6477201-a40a-4db9-b330-2f7b061f34c8 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:23.559799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:23.565128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3a74-176d-4a91-9c5a-1263cd81bb13 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:23.565578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3a74-176d-4a91-9c5a-1263cd81bb13 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:23.565800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3a74-176d-4a91-9c5a-1263cd81bb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:23.634465 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c35e3a74-176d-4a91-9c5a-1263cd81bb13 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:23.635689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c35e3a74-176d-4a91-9c5a-1263cd81bb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:23.675113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:23.734940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:24.017575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477201-a40a-4db9-b330-2f7b061f34c8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:24.019153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c6477201-a40a-4db9-b330-2f7b061f34c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:24.122411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6477201-a40a-4db9-b330-2f7b061f34c8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:24.159198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:24.195841 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d16654-4757-40bf-814e-e5cb29a4d5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:24.196450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16654-4757-40bf-814e-e5cb29a4d5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:24.196754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16654-4757-40bf-814e-e5cb29a4d5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:24.197027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16654-4757-40bf-814e-e5cb29a4d5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:24.198627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e9d16654-4757-40bf-814e-e5cb29a4d5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:24.314671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d16654-4757-40bf-814e-e5cb29a4d5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:24.316029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d16654-4757-40bf-814e-e5cb29a4d5f0 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:24.335394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 732/1464] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:26.251619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800314-29e8-4722-ba69-fee9b10ea2da None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:26.252187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800314-29e8-4722-ba69-fee9b10ea2da None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:26.252187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800314-29e8-4722-ba69-fee9b10ea2da None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:26.253576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:26.259746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23caf8-b02c-4288-a89d-bd156282ac52 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:26.260273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23caf8-b02c-4288-a89d-bd156282ac52 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:26.260371 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23caf8-b02c-4288-a89d-bd156282ac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:26.327814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-da23caf8-b02c-4288-a89d-bd156282ac52 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:26.329058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-da23caf8-b02c-4288-a89d-bd156282ac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:26.347896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:26.431862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:26.717874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc800314-29e8-4722-ba69-fee9b10ea2da None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:26.719868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dc800314-29e8-4722-ba69-fee9b10ea2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:26.852399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc800314-29e8-4722-ba69-fee9b10ea2da None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:26.923023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:26.930711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efc266-314b-445f-b943-5c6d12bccb0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:26.931323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc266-314b-445f-b943-5c6d12bccb0a service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:26.931604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc266-314b-445f-b943-5c6d12bccb0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:26.931880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efc266-314b-445f-b943-5c6d12bccb0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:26.933522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-67efc266-314b-445f-b943-5c6d12bccb0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:27.048129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efc266-314b-445f-b943-5c6d12bccb0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:27.049530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efc266-314b-445f-b943-5c6d12bccb0a service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:27.069473 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 734/1467] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:29.016981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436024-46ad-4731-8a55-fdced721a963 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:29.017589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436024-46ad-4731-8a55-fdced721a963 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:29.017589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436024-46ad-4731-8a55-fdced721a963 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:29.018934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:29.024227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d52e29-c0a5-44ac-a679-0fbbb1fa4a07 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:29.024758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d52e29-c0a5-44ac-a679-0fbbb1fa4a07 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:29.024872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d52e29-c0a5-44ac-a679-0fbbb1fa4a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:29.094848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-49d52e29-c0a5-44ac-a679-0fbbb1fa4a07 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:29.096077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-49d52e29-c0a5-44ac-a679-0fbbb1fa4a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:29.145520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:29.193956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 16:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:58:29.481678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd436024-46ad-4731-8a55-fdced721a963 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:29.483483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dd436024-46ad-4731-8a55-fdced721a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:29.589303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd436024-46ad-4731-8a55-fdced721a963 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:29.637552 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:29.665274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae7aef-03a9-4e0f-85ed-e25a1ed5531d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:29.665889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae7aef-03a9-4e0f-85ed-e25a1ed5531d service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:29.666165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae7aef-03a9-4e0f-85ed-e25a1ed5531d service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:29.666435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae7aef-03a9-4e0f-85ed-e25a1ed5531d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:29.668053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6dae7aef-03a9-4e0f-85ed-e25a1ed5531d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:29.779154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae7aef-03a9-4e0f-85ed-e25a1ed5531d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:29.780623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae7aef-03a9-4e0f-85ed-e25a1ed5531d service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:29.802473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 735/1470] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:39.192240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=22 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:39.799416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=66 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:50.067951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8693d-7c46-47af-8ba0-6a72bbb92bf7 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:50.068516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8693d-7c46-47af-8ba0-6a72bbb92bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:50.068516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8693d-7c46-47af-8ba0-6a72bbb92bf7 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:50.069795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 736/1471] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:50.075042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66b60a-1074-49d3-9ce6-7c56d204d4c0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:50.075499 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66b60a-1074-49d3-9ce6-7c56d204d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:50.075615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66b60a-1074-49d3-9ce6-7c56d204d4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:50.141055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2f66b60a-1074-49d3-9ce6-7c56d204d4c0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:50.142267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2f66b60a-1074-49d3-9ce6-7c56d204d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:50.238062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 736/1472] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:50.533385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc02c06-1c4e-4d7c-8bbb-caef7bddc0a2 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:50.533674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc02c06-1c4e-4d7c-8bbb-caef7bddc0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:50.533986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc02c06-1c4e-4d7c-8bbb-caef7bddc0a2 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:50.535324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 737/1473] 10.222.0.81 () {54 vars in 967 bytes} [Thu Aug 18 16:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:50.540200 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bb480-4aef-4b2c-8c93-6cb65716b30b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:50.540513 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bb480-4aef-4b2c-8c93-6cb65716b30b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:50.540796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bb480-4aef-4b2c-8c93-6cb65716b30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:50.616673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ca2bb480-4aef-4b2c-8c93-6cb65716b30b None None] MFA Rules not processed for user `a710cfeadd004a8bbf932f6bb3b211e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:50.617875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ca2bb480-4aef-4b2c-8c93-6cb65716b30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:50.638346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:50.694111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 737/1474] 10.222.0.81 () {58 vars in 1064 bytes} [Thu Aug 18 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:50.701748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc02c06-1c4e-4d7c-8bbb-caef7bddc0a2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:50.703252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3cc02c06-1c4e-4d7c-8bbb-caef7bddc0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:50.808787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc02c06-1c4e-4d7c-8bbb-caef7bddc0a2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:50.881799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bb87e-cd4a-4114-aa2a-19b090e4cb1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a710cfeadd004a8bbf932f6bb3b211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:50.882407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bb87e-cd4a-4114-aa2a-19b090e4cb1a service glance] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:50.882690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bb87e-cd4a-4114-aa2a-19b090e4cb1a service glance] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:50.882966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bb87e-cd4a-4114-aa2a-19b090e4cb1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:50.884596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a59bb87e-cd4a-4114-aa2a-19b090e4cb1a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:50.938185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:50.992417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bb87e-cd4a-4114-aa2a-19b090e4cb1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:50.993867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bb87e-cd4a-4114-aa2a-19b090e4cb1a service glance] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:51.012794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 738/1475] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:52.993139 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957c969-4009-4777-b945-e734c5d5ad0b None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:52.993700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957c969-4009-4777-b945-e734c5d5ad0b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:52.993700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957c969-4009-4777-b945-e734c5d5ad0b None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:52.995019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 738/1476] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:53.001780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4e708-05cf-471c-94d7-018bfd3319a7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:53.001780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4e708-05cf-471c-94d7-018bfd3319a7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:53.002466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4e708-05cf-471c-94d7-018bfd3319a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:53.073023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d9d4e708-05cf-471c-94d7-018bfd3319a7 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:53.074246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d9d4e708-05cf-471c-94d7-018bfd3319a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:53.174187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 739/1477] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:58:53.446394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957c969-4009-4777-b945-e734c5d5ad0b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:53.447943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f957c969-4009-4777-b945-e734c5d5ad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:53.571957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957c969-4009-4777-b945-e734c5d5ad0b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:53.621002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:53.667390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad4b3b-8bab-478a-be31-03da6d45351f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:53.668002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad4b3b-8bab-478a-be31-03da6d45351f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:53.668278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad4b3b-8bab-478a-be31-03da6d45351f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:53.668580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad4b3b-8bab-478a-be31-03da6d45351f admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:53.669215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad4b3b-8bab-478a-be31-03da6d45351f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:53.670943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-cbad4b3b-8bab-478a-be31-03da6d45351f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:58:53.670943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 18 16:58:53.670943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: Aug 18 16:58:53.672072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad4b3b-8bab-478a-be31-03da6d45351f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:53.690625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 739/1478] 10.222.0.81 () {56 vars in 1108 bytes} [Thu Aug 18 16:58:53 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 16:58:55.617496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69611e66-a032-40e8-9140-b318bf117e4d None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:55.618099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69611e66-a032-40e8-9140-b318bf117e4d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:55.618099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69611e66-a032-40e8-9140-b318bf117e4d None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:55.619560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 740/1479] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:58:55.624781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8c900-6f0f-4986-84dd-a45073b7aaa9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:55.625285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8c900-6f0f-4986-84dd-a45073b7aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:55.625391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8c900-6f0f-4986-84dd-a45073b7aaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:55.690706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-45f8c900-6f0f-4986-84dd-a45073b7aaa9 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:55.691936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-45f8c900-6f0f-4986-84dd-a45073b7aaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:55.795664 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 740/1480] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:58:56.086883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69611e66-a032-40e8-9140-b318bf117e4d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:56.088450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-69611e66-a032-40e8-9140-b318bf117e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:56.099322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:56.249749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69611e66-a032-40e8-9140-b318bf117e4d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:56.339316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:56.375764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc8f12-292a-4828-8a4f-9d13537bda5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:56.376379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8f12-292a-4828-8a4f-9d13537bda5f service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:56.376687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8f12-292a-4828-8a4f-9d13537bda5f service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:56.376964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8f12-292a-4828-8a4f-9d13537bda5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:56.378617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bcbc8f12-292a-4828-8a4f-9d13537bda5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:56.470145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc8f12-292a-4828-8a4f-9d13537bda5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:56.472400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc8f12-292a-4828-8a4f-9d13537bda5f service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:56.490502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 741/1481] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:58:58.560856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87af12-c63b-4ab4-80d0-fec3730a8d46 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:58.561514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87af12-c63b-4ab4-80d0-fec3730a8d46 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:58.561514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87af12-c63b-4ab4-80d0-fec3730a8d46 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:58.562733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 741/1482] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 16:58:58.568572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b6f2-1695-4d66-a4a6-a25cf3e331d6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:58.569061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b6f2-1695-4d66-a4a6-a25cf3e331d6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:58.569165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b6f2-1695-4d66-a4a6-a25cf3e331d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:58.638861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e069b6f2-1695-4d66-a4a6-a25cf3e331d6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:58:58.640128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e069b6f2-1695-4d66-a4a6-a25cf3e331d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:58.686518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:58.737623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 742/1483] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:58:59.020402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87af12-c63b-4ab4-80d0-fec3730a8d46 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:58:59.021967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-de87af12-c63b-4ab4-80d0-fec3730a8d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:59.047102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:59.128090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87af12-c63b-4ab4-80d0-fec3730a8d46 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:58:59.200007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fc474-0b53-47b4-8a92-57b258e12999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:58:59.200553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fc474-0b53-47b4-8a92-57b258e12999 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:58:59.200832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fc474-0b53-47b4-8a92-57b258e12999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:58:59.201102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fc474-0b53-47b4-8a92-57b258e12999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:58:59.202691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3e3fc474-0b53-47b4-8a92-57b258e12999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:58:59.277542 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:59.313925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fc474-0b53-47b4-8a92-57b258e12999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:58:59.315377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fc474-0b53-47b4-8a92-57b258e12999 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:58:59.333849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 742/1484] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:59:01.268324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63f5b5-bb16-4af0-85e2-cdaaf75f43b5 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:59:01.268912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63f5b5-bb16-4af0-85e2-cdaaf75f43b5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:59:01.268912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63f5b5-bb16-4af0-85e2-cdaaf75f43b5 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:59:01.270327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 743/1485] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:59:01.275481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db0713-c25a-4f19-aa9d-1d64300ff4c6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:59:01.275926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db0713-c25a-4f19-aa9d-1d64300ff4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:59:01.276034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db0713-c25a-4f19-aa9d-1d64300ff4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:59:01.341242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-15db0713-c25a-4f19-aa9d-1d64300ff4c6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:59:01.342357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-15db0713-c25a-4f19-aa9d-1d64300ff4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:59:01.437637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 743/1486] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:59:01.730576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63f5b5-bb16-4af0-85e2-cdaaf75f43b5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:59:01.732121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ac63f5b5-bb16-4af0-85e2-cdaaf75f43b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:59:01.835329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63f5b5-bb16-4af0-85e2-cdaaf75f43b5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:59:01.906837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:59:01.909483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a638724-b714-4090-89a9-bbcdb2cc2817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:59:01.910333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638724-b714-4090-89a9-bbcdb2cc2817 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:59:01.910684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638724-b714-4090-89a9-bbcdb2cc2817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:59:01.911116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638724-b714-4090-89a9-bbcdb2cc2817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:59:01.912962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0a638724-b714-4090-89a9-bbcdb2cc2817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:59:02.022784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a638724-b714-4090-89a9-bbcdb2cc2817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:59:02.024142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a638724-b714-4090-89a9-bbcdb2cc2817 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:59:02.042594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 744/1487] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:59:04.024908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a466b-e74d-4556-bc7e-56c50fbd0079 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:59:04.025440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a466b-e74d-4556-bc7e-56c50fbd0079 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:59:04.025440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a466b-e74d-4556-bc7e-56c50fbd0079 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:59:04.026747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 744/1488] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:59:04.032006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f698c6-5d32-48c5-9b54-f803795475ef None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:59:04.032450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f698c6-5d32-48c5-9b54-f803795475ef None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:59:04.032605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f698c6-5d32-48c5-9b54-f803795475ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:59:04.099306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-57f698c6-5d32-48c5-9b54-f803795475ef None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:59:04.100538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-57f698c6-5d32-48c5-9b54-f803795475ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:59:04.153252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:59:04.197685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 745/1489] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 16:59:04.488982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a466b-e74d-4556-bc7e-56c50fbd0079 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:59:04.490523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e14a466b-e74d-4556-bc7e-56c50fbd0079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:59:04.526051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:59:04.593826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a466b-e74d-4556-bc7e-56c50fbd0079 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:59:04.669036 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef7990-9d11-4fcc-9f18-65c98fa6e911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:59:04.669644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef7990-9d11-4fcc-9f18-65c98fa6e911 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:59:04.669926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef7990-9d11-4fcc-9f18-65c98fa6e911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:59:04.670202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef7990-9d11-4fcc-9f18-65c98fa6e911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:59:04.671807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2eef7990-9d11-4fcc-9f18-65c98fa6e911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:59:04.752228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:59:04.782220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef7990-9d11-4fcc-9f18-65c98fa6e911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:59:04.783316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef7990-9d11-4fcc-9f18-65c98fa6e911 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:59:04.802573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 745/1490] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:59:06.897370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfc85f-eb2e-40a3-8314-230cd796d840 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:59:06.897939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfc85f-eb2e-40a3-8314-230cd796d840 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:59:06.897939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfc85f-eb2e-40a3-8314-230cd796d840 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:59:06.899312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 746/1491] 10.222.0.81 () {54 vars in 927 bytes} [Thu Aug 18 16:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 16:59:06.904602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0937da-fcaa-4e33-8077-9eedccaa3ab6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:59:06.905043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0937da-fcaa-4e33-8077-9eedccaa3ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:59:06.905163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0937da-fcaa-4e33-8077-9eedccaa3ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:59:06.970719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-df0937da-fcaa-4e33-8077-9eedccaa3ab6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 16:59:06.972568 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-df0937da-fcaa-4e33-8077-9eedccaa3ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:59:07.067278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 746/1492] 10.222.0.81 () {58 vars in 1024 bytes} [Thu Aug 18 16:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 16:59:07.354391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfc85f-eb2e-40a3-8314-230cd796d840 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 16:59:07.355943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b1cfc85f-eb2e-40a3-8314-230cd796d840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:59:07.463999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfc85f-eb2e-40a3-8314-230cd796d840 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 16:59:07.537308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445412c-446c-4ed5-9cb6-56e73e24853b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 16:59:07.537918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445412c-446c-4ed5-9cb6-56e73e24853b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 16:59:07.538201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445412c-446c-4ed5-9cb6-56e73e24853b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 16:59:07.538469 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445412c-446c-4ed5-9cb6-56e73e24853b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 16:59:07.540048 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5445412c-446c-4ed5-9cb6-56e73e24853b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 16:59:07.549631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:59:07.662930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445412c-446c-4ed5-9cb6-56e73e24853b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 16:59:07.664297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445412c-446c-4ed5-9cb6-56e73e24853b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 16:59:07.682706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 747/1493] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 16:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 16:59:17.065466 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=82 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:59:17.680422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=50 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:19.905840 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49052c8-73cb-4873-a00c-d6fd8ab3489d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:19.906445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49052c8-73cb-4873-a00c-d6fd8ab3489d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:19.906445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49052c8-73cb-4873-a00c-d6fd8ab3489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:19.984439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b49052c8-73cb-4873-a00c-d6fd8ab3489d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:00:19.986178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b49052c8-73cb-4873-a00c-d6fd8ab3489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:20.083213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 747/1494] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:00:20.091331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899e12-20ba-43ff-897d-311cab679b3f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:20.091825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899e12-20ba-43ff-897d-311cab679b3f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:20.091935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899e12-20ba-43ff-897d-311cab679b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:20.166509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-21899e12-20ba-43ff-897d-311cab679b3f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:00:20.167704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-21899e12-20ba-43ff-897d-311cab679b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:20.262324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 748/1495] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:00:20.267751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49052c8-73cb-4873-a00c-d6fd8ab3489d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:00:20.268992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b49052c8-73cb-4873-a00c-d6fd8ab3489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:20.280295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49052c8-73cb-4873-a00c-d6fd8ab3489d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:00:20.340588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:20.373565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:00:20.374196 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:20.374475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:20.374747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:20.375385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:00:20.376799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:00:20.377283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:00:20.377283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 18 17:00:20.377283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: Aug 18 17:00:20.378152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:00:20.389475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 748/1496] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:00:20.398425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21899e12-20ba-43ff-897d-311cab679b3f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:00:20.407582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21899e12-20ba-43ff-897d-311cab679b3f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:00:20.468762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:20.503678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1cc2f-cade-4d44-992a-bc665b14d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:00:20.504305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1cc2f-cade-4d44-992a-bc665b14d710 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:20.504632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1cc2f-cade-4d44-992a-bc665b14d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:20.504905 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1cc2f-cade-4d44-992a-bc665b14d710 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:20.505542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1cc2f-cade-4d44-992a-bc665b14d710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:00:20.507303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-d5c1cc2f-cade-4d44-992a-bc665b14d710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:00:20.507303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 18 17:00:20.507303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: Aug 18 17:00:20.508523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1cc2f-cade-4d44-992a-bc665b14d710 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:00:20.566137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 749/1497] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:00:20 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:00:20.570530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:00:20.572080 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:20.605635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeebb09-8087-4c04-b04b-4934ad5a5e80 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:00:20.698972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c32f30-987b-4cd5-8063-163ba53fd85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:00:20.699577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c32f30-987b-4cd5-8063-163ba53fd85b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:20.699856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c32f30-987b-4cd5-8063-163ba53fd85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:20.700128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c32f30-987b-4cd5-8063-163ba53fd85b admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:20.700781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c32f30-987b-4cd5-8063-163ba53fd85b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:00:20.701904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-03c32f30-987b-4cd5-8063-163ba53fd85b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:00:20.701904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 18 17:00:20.701904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: Aug 18 17:00:20.703700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c32f30-987b-4cd5-8063-163ba53fd85b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:00:20.752962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 749/1498] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:00:20 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:00:20.757200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1cc2f-cade-4d44-992a-bc665b14d710 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:00:20.758718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d5c1cc2f-cade-4d44-992a-bc665b14d710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:20.822055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1cc2f-cade-4d44-992a-bc665b14d710 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:00:20.907292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:20.919513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042234e7-a019-47c8-8c8d-a21a6026948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:00:20.920126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042234e7-a019-47c8-8c8d-a21a6026948f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:20.920408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042234e7-a019-47c8-8c8d-a21a6026948f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:20.920714 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042234e7-a019-47c8-8c8d-a21a6026948f admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:20.921358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042234e7-a019-47c8-8c8d-a21a6026948f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:00:20.922389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-042234e7-a019-47c8-8c8d-a21a6026948f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:00:20.922389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 18 17:00:20.922389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: Aug 18 17:00:20.923313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042234e7-a019-47c8-8c8d-a21a6026948f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:00:20.935555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 750/1499] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:00:20.940236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c32f30-987b-4cd5-8063-163ba53fd85b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:00:20.941832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-03c32f30-987b-4cd5-8063-163ba53fd85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:20.953063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c32f30-987b-4cd5-8063-163ba53fd85b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:00:20.978483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:21.054846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea691e1e-ac94-4ce3-a5ea-cb6709d1d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:00:21.055460 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea691e1e-ac94-4ce3-a5ea-cb6709d1d92b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:21.055737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea691e1e-ac94-4ce3-a5ea-cb6709d1d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:21.056005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea691e1e-ac94-4ce3-a5ea-cb6709d1d92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:21.056681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea691e1e-ac94-4ce3-a5ea-cb6709d1d92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:00:21.057703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-ea691e1e-ac94-4ce3-a5ea-cb6709d1d92b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:00:21.057703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 18 17:00:21.057703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: Aug 18 17:00:21.058579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea691e1e-ac94-4ce3-a5ea-cb6709d1d92b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:00:21.070995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 750/1500] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:00:21.075276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042234e7-a019-47c8-8c8d-a21a6026948f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:00:21.076832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-042234e7-a019-47c8-8c8d-a21a6026948f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:21.110009 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042234e7-a019-47c8-8c8d-a21a6026948f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:00:21.204911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd20fc0-a49a-4189-a79b-c30dccc993b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:00:21.205590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd20fc0-a49a-4189-a79b-c30dccc993b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:21.205871 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd20fc0-a49a-4189-a79b-c30dccc993b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:21.206147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd20fc0-a49a-4189-a79b-c30dccc993b8 admin admin] PATH_INFO: `/v3/projects/49199a145e1146ce86866aeb528af12c/users/a395e1d0ad984547b939ab52dbbff959/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:21.229317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd20fc0-a49a-4189-a79b-c30dccc993b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49199a145e1146ce86866aeb528af12c, user_id=a395e1d0ad984547b939ab52dbbff959, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:00:21.230336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-7fd20fc0-a49a-4189-a79b-c30dccc993b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:00:21.230336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 18 17:00:21.230336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: Aug 18 17:00:21.232554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd20fc0-a49a-4189-a79b-c30dccc993b8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:00:21.256749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 751/1501] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:00:21 2022] PUT /identity/v3/projects/49199a145e1146ce86866aeb528af12c/users/a395e1d0ad984547b939ab52dbbff959/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:00:21.269510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79f37e-7bf0-4536-84d7-590eaead7cfc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:21.269798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79f37e-7bf0-4536-84d7-590eaead7cfc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:21.270075 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79f37e-7bf0-4536-84d7-590eaead7cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:21.325995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2d79f37e-7bf0-4536-84d7-590eaead7cfc None None] MFA Rules not processed for user `a395e1d0ad984547b939ab52dbbff959`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:00:21.327211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2d79f37e-7bf0-4536-84d7-590eaead7cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:21.404433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 751/1502] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:00:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:00:21.418286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5ed1c-a711-482b-bf65-0d1862503a3a None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:21.418573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5ed1c-a711-482b-bf65-0d1862503a3a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:21.418854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5ed1c-a711-482b-bf65-0d1862503a3a None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:21.420182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 752/1503] 10.222.0.81 () {54 vars in 964 bytes} [Thu Aug 18 17:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:00:21.424883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b278973-b43b-4a47-a3fe-1448832196a6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:21.425171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b278973-b43b-4a47-a3fe-1448832196a6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:21.425447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b278973-b43b-4a47-a3fe-1448832196a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:21.457667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:21.503234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2b278973-b43b-4a47-a3fe-1448832196a6 None None] MFA Rules not processed for user `2aa331983fbc4b18b7880084adcba3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:00:21.504473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2b278973-b43b-4a47-a3fe-1448832196a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:21.581031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 752/1504] 10.222.0.81 () {58 vars in 1061 bytes} [Thu Aug 18 17:00:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:00:21.588874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5ed1c-a711-482b-bf65-0d1862503a3a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:00:21.590378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50a5ed1c-a711-482b-bf65-0d1862503a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:21.640043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:21.697004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5ed1c-a711-482b-bf65-0d1862503a3a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:00:21.775892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c208f07-89eb-47ca-9641-63c286f2cbb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:00:21.776528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c208f07-89eb-47ca-9641-63c286f2cbb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:21.776813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c208f07-89eb-47ca-9641-63c286f2cbb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:21.777200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c208f07-89eb-47ca-9641-63c286f2cbb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:21.779048 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5c208f07-89eb-47ca-9641-63c286f2cbb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:21.878521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c208f07-89eb-47ca-9641-63c286f2cbb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:00:21.879982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c208f07-89eb-47ca-9641-63c286f2cbb6 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:00:21.883458 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:21.898762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 753/1505] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:00:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:00:21.943764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3260a-ce1d-4712-9746-ae9deca0f818 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:21.944232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3260a-ce1d-4712-9746-ae9deca0f818 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:21.944340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3260a-ce1d-4712-9746-ae9deca0f818 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:21.945628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 753/1506] 10.222.0.81 () {52 vars in 830 bytes} [Thu Aug 18 17:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:00:21.949167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c208f07-89eb-47ca-9641-63c286f2cbb6 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:00:21.950375 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5c208f07-89eb-47ca-9641-63c286f2cbb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:22.050207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c208f07-89eb-47ca-9641-63c286f2cbb6 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:00:22.143378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:00:22.144072 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:22.144280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:22.144583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] PATH_INFO: `/v3/users/a395e1d0ad984547b939ab52dbbff959` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:22.156686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a395e1d0ad984547b939ab52dbbff959)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:00:22.157743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:00:22.157743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 18 17:00:22.157743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: Aug 18 17:00:22.158954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:00:22.168543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:22.223212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a395e1d0ad984547b939ab52dbbff959'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:00:22.232733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a395e1d0ad984547b939ab52dbbff959'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:00:22.233291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a395e1d0ad984547b939ab52dbbff959'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:00:22.233711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a395e1d0ad984547b939ab52dbbff959'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:00:22.248982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a395e1d0ad984547b939ab52dbbff959'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:00:22.277091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 754/1507] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:00:21 2022] DELETE /identity/v3/users/a395e1d0ad984547b939ab52dbbff959 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:00:22.281516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944a44b-06e6-451c-a396-f26fa34f0120 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:22.281827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944a44b-06e6-451c-a396-f26fa34f0120 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:22.282599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944a44b-06e6-451c-a396-f26fa34f0120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:22.341905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f944a44b-06e6-451c-a396-f26fa34f0120 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:00:22.343128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f944a44b-06e6-451c-a396-f26fa34f0120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:22.419372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:22.431937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 754/1508] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:00:22.443520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:00:22.444779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:22.545794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a405190-102b-4c37-884b-f8c0aae0d003 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:00:22.603149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:22.625006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50643a77-d942-4c67-a179-793b2a4ab1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:00:22.625634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50643a77-d942-4c67-a179-793b2a4ab1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:22.625919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50643a77-d942-4c67-a179-793b2a4ab1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:22.626195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50643a77-d942-4c67-a179-793b2a4ab1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:22.627801 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50643a77-d942-4c67-a179-793b2a4ab1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:22.736623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50643a77-d942-4c67-a179-793b2a4ab1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:00:22.738065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50643a77-d942-4c67-a179-793b2a4ab1d0 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:00:22.756742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 755/1509] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:00:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:00:23.082272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944a44b-06e6-451c-a396-f26fa34f0120 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:00:23.083509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f944a44b-06e6-451c-a396-f26fa34f0120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:00:23.094994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944a44b-06e6-451c-a396-f26fa34f0120 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:00:23.194030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:00:23.194669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:00:23.194949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:00:23.195222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] PATH_INFO: `/v3/projects/49199a145e1146ce86866aeb528af12c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:00:23.204960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49199a145e1146ce86866aeb528af12c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:00:23.205987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:00:23.205987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 18 17:00:23.205987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: Aug 18 17:00:23.207184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:00:23.265646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49199a145e1146ce86866aeb528af12c', 'request_id': 'req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:00:23.275121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49199a145e1146ce86866aeb528af12c', 'request_id': 'req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:00:23.289621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49199a145e1146ce86866aeb528af12c', 'request_id': 'req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:00:23.313062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] The token cache is being invalidate because project 49199a145e1146ce86866aeb528af12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:00:23.313349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:00:23.313780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1bdfaaa8-3136-4bbe-b5c8-a9e90f3c01c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:00:23.315191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 755/1510] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:00:23 2022] DELETE /identity/v3/projects/49199a145e1146ce86866aeb528af12c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:00:32.754329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=62 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:33.311055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:02:00.486070 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8f054-1ae9-4570-b498-81b3b4d9e084 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:00.486698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8f054-1ae9-4570-b498-81b3b4d9e084 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:00.486698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8f054-1ae9-4570-b498-81b3b4d9e084 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:00.487990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 17:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:02:00.492805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069106b-b6a6-45c7-8063-c65584719f52 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:00.493267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069106b-b6a6-45c7-8063-c65584719f52 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:00.493371 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069106b-b6a6-45c7-8063-c65584719f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:00.574706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1069106b-b6a6-45c7-8063-c65584719f52 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:02:00.575903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1069106b-b6a6-45c7-8063-c65584719f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:00.680851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 17:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:02:00.833310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8f054-1ae9-4570-b498-81b3b4d9e084 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:02:00.835474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-67f8f054-1ae9-4570-b498-81b3b4d9e084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:00.951938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8f054-1ae9-4570-b498-81b3b4d9e084 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:02:00.958401 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6c8dc-2927-45ec-a112-08698cd27c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:02:00.959007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6c8dc-2927-45ec-a112-08698cd27c19 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:00.959289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6c8dc-2927-45ec-a112-08698cd27c19 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:00.959565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6c8dc-2927-45ec-a112-08698cd27c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:00.967561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6c8dc-2927-45ec-a112-08698cd27c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:02:00.969710 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6c8dc-2927-45ec-a112-08698cd27c19 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:02:00.979036 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 757/1513] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:02:01.816895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a3a1f-9620-4210-92f6-8e0e4b06dd10 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:01.817467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a3a1f-9620-4210-92f6-8e0e4b06dd10 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:01.817467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a3a1f-9620-4210-92f6-8e0e4b06dd10 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:01.818816 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 17:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:02:01.823655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c45a02-3b7c-470e-99bc-0ffbc1d4f3e4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:01.824074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c45a02-3b7c-470e-99bc-0ffbc1d4f3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:01.824219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c45a02-3b7c-470e-99bc-0ffbc1d4f3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:01.844480 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-08c45a02-3b7c-470e-99bc-0ffbc1d4f3e4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:02:01.845691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-08c45a02-3b7c-470e-99bc-0ffbc1d4f3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:01.853532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 17:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:02:02.002380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a3a1f-9620-4210-92f6-8e0e4b06dd10 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:02:02.017114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a3a1f-9620-4210-92f6-8e0e4b06dd10 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:02:02.022488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb8145-e6fc-438c-bd0f-d28dd6023f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:02:02.023090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb8145-e6fc-438c-bd0f-d28dd6023f18 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:02.023372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb8145-e6fc-438c-bd0f-d28dd6023f18 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:02.023647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb8145-e6fc-438c-bd0f-d28dd6023f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:02.031696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb8145-e6fc-438c-bd0f-d28dd6023f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:02:02.033315 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb8145-e6fc-438c-bd0f-d28dd6023f18 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:02:02.043260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 758/1516] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:02:02.814319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa491da-e6c7-4f25-9709-dc8b0d09d1c2 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:02.814598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa491da-e6c7-4f25-9709-dc8b0d09d1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:02.814861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa491da-e6c7-4f25-9709-dc8b0d09d1c2 None None] PATH_INFO: `/v3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:02.816143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 759/1517] 10.222.0.85 () {54 vars in 925 bytes} [Thu Aug 18 17:02:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:02:02.823280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2eb38-a1c7-4578-842a-cbc247675312 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:02.823754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2eb38-a1c7-4578-842a-cbc247675312 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:02.823875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2eb38-a1c7-4578-842a-cbc247675312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:02.884254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d3c2eb38-a1c7-4578-842a-cbc247675312 None None] MFA Rules not processed for user `4cc1ad7e47454b5d9d2ef2190414010c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:02:02.885555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d3c2eb38-a1c7-4578-842a-cbc247675312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:02.903325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:02:02.957540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 759/1518] 10.222.0.85 () {58 vars in 1015 bytes} [Thu Aug 18 17:02:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:02:06.869164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd111-61c3-41a8-9f38-f9bf99e19057 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:06.869802 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd111-61c3-41a8-9f38-f9bf99e19057 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:06.869802 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd111-61c3-41a8-9f38-f9bf99e19057 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:06.870967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 760/1519] 10.222.0.81 () {54 vars in 961 bytes} [Thu Aug 18 17:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:02:06.876588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42480c9-09be-43dc-a755-df12f5332b05 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:06.877044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42480c9-09be-43dc-a755-df12f5332b05 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:06.877149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42480c9-09be-43dc-a755-df12f5332b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:06.895810 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e42480c9-09be-43dc-a755-df12f5332b05 None None] MFA Rules not processed for user `4cc1ad7e47454b5d9d2ef2190414010c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:02:06.897017 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e42480c9-09be-43dc-a755-df12f5332b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:06.905233 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 760/1520] 10.222.0.81 () {58 vars in 1058 bytes} [Thu Aug 18 17:02:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:02:06.912622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd111-61c3-41a8-9f38-f9bf99e19057 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:02:06.926858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd111-61c3-41a8-9f38-f9bf99e19057 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:02:06.931812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109723e4-6ff1-43c5-9474-1da77b29567a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:02:06.932408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109723e4-6ff1-43c5-9474-1da77b29567a service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:06.932712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109723e4-6ff1-43c5-9474-1da77b29567a service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:06.932987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109723e4-6ff1-43c5-9474-1da77b29567a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:06.941582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109723e4-6ff1-43c5-9474-1da77b29567a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:02:06.943147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109723e4-6ff1-43c5-9474-1da77b29567a service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:02:06.952771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 761/1521] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:02:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:02:13.271082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4ce9-b14e-4290-9215-f4ef2c2a4dad None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:13.271707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4ce9-b14e-4290-9215-f4ef2c2a4dad None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:13.271707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b4ce9-b14e-4290-9215-f4ef2c2a4dad None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:13.273041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 17:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:02:13.277784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d06c9c-7297-46e0-b157-47a551b0db59 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:13.278176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d06c9c-7297-46e0-b157-47a551b0db59 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:13.278273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d06c9c-7297-46e0-b157-47a551b0db59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:13.298186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a6d06c9c-7297-46e0-b157-47a551b0db59 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:02:13.299365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a6d06c9c-7297-46e0-b157-47a551b0db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:13.307073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:02:13.458415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b4ce9-b14e-4290-9215-f4ef2c2a4dad None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:02:13.473872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b4ce9-b14e-4290-9215-f4ef2c2a4dad None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:02:13.479284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58259d-c343-4db9-aa75-fb511f57c5e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:02:13.479889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58259d-c343-4db9-aa75-fb511f57c5e6 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:13.480171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58259d-c343-4db9-aa75-fb511f57c5e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:13.480447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58259d-c343-4db9-aa75-fb511f57c5e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:13.489685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58259d-c343-4db9-aa75-fb511f57c5e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:02:13.491269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58259d-c343-4db9-aa75-fb511f57c5e6 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:02:13.500658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 762/1524] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:02:14.320332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d5d61-6fdc-487f-8b93-b906713f02c0 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:14.320920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d5d61-6fdc-487f-8b93-b906713f02c0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:14.320920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d5d61-6fdc-487f-8b93-b906713f02c0 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:14.322558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 17:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:02:14.328295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7096-97f9-4140-b671-c5fab9296880 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:14.328762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7096-97f9-4140-b671-c5fab9296880 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:14.328869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7096-97f9-4140-b671-c5fab9296880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:14.347513 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3bdd7096-97f9-4140-b671-c5fab9296880 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:02:14.348734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3bdd7096-97f9-4140-b671-c5fab9296880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:14.356634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 17:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:02:14.508104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d5d61-6fdc-487f-8b93-b906713f02c0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:02:14.522319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d5d61-6fdc-487f-8b93-b906713f02c0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:02:14.528052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc56891-17a8-4378-8b1e-e13885e6195b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:02:14.528710 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc56891-17a8-4378-8b1e-e13885e6195b service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:14.528991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc56891-17a8-4378-8b1e-e13885e6195b service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:14.529264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc56891-17a8-4378-8b1e-e13885e6195b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:14.537483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc56891-17a8-4378-8b1e-e13885e6195b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:02:14.539058 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc56891-17a8-4378-8b1e-e13885e6195b service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:02:14.549031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 764/1527] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:02:18.516360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5f765-5bc5-499c-bb3f-92924eb0c52a None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:18.516949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5f765-5bc5-499c-bb3f-92924eb0c52a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:18.516949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5f765-5bc5-499c-bb3f-92924eb0c52a None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:18.518323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 17:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:02:18.524661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba9d43-3057-49ea-aa1b-f50a578a3922 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:18.525199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba9d43-3057-49ea-aa1b-f50a578a3922 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:18.525315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba9d43-3057-49ea-aa1b-f50a578a3922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:18.545302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ffba9d43-3057-49ea-aa1b-f50a578a3922 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:02:18.547095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ffba9d43-3057-49ea-aa1b-f50a578a3922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:18.554996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 17:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:02:18.841497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5f765-5bc5-499c-bb3f-92924eb0c52a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:02:18.843724 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-71c5f765-5bc5-499c-bb3f-92924eb0c52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:18.920872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5f765-5bc5-499c-bb3f-92924eb0c52a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:02:18.924451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc166e2-84ca-48c5-afe2-9834ede31f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:02:18.925085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc166e2-84ca-48c5-afe2-9834ede31f00 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:18.925362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc166e2-84ca-48c5-afe2-9834ede31f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:18.925634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc166e2-84ca-48c5-afe2-9834ede31f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:18.934374 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc166e2-84ca-48c5-afe2-9834ede31f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:02:18.935792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc166e2-84ca-48c5-afe2-9834ede31f00 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:02:18.945070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 765/1530] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:02:20.862750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3251ac-3a0f-4cb9-9599-2ff3c1a46054 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:20.863345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3251ac-3a0f-4cb9-9599-2ff3c1a46054 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:20.863345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3251ac-3a0f-4cb9-9599-2ff3c1a46054 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:20.864664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 17:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:02:20.869835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b614a9-fb51-4066-8141-5b2bf3c05a71 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:20.870244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b614a9-fb51-4066-8141-5b2bf3c05a71 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:20.870454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b614a9-fb51-4066-8141-5b2bf3c05a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:20.890903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-40b614a9-fb51-4066-8141-5b2bf3c05a71 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:02:20.892105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-40b614a9-fb51-4066-8141-5b2bf3c05a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:20.899954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 17:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:02:21.180118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3251ac-3a0f-4cb9-9599-2ff3c1a46054 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:02:21.190762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3251ac-3a0f-4cb9-9599-2ff3c1a46054 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:02:21.194253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5c02e-f540-4419-8710-7e229e47c367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:02:21.194851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c02e-f540-4419-8710-7e229e47c367 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:21.195131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c02e-f540-4419-8710-7e229e47c367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:21.195403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c02e-f540-4419-8710-7e229e47c367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:21.204673 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5c02e-f540-4419-8710-7e229e47c367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:02:21.206094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5c02e-f540-4419-8710-7e229e47c367 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:02:21.215320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 767/1533] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:02:24.628580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f014f-aa52-4b40-a5c5-2a72cdbaf7b7 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:24.629161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f014f-aa52-4b40-a5c5-2a72cdbaf7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:24.629161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f014f-aa52-4b40-a5c5-2a72cdbaf7b7 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:24.630477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 17:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:02:24.635560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fd031-3e8a-4a4c-993e-d2c70ce7ba07 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:24.635972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fd031-3e8a-4a4c-993e-d2c70ce7ba07 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:24.636181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fd031-3e8a-4a4c-993e-d2c70ce7ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:24.644318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=81 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:02:24.657040 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4c4fd031-3e8a-4a4c-993e-d2c70ce7ba07 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:02:24.658228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4c4fd031-3e8a-4a4c-993e-d2c70ce7ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:24.665965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:02:25.215974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f014f-aa52-4b40-a5c5-2a72cdbaf7b7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:02:25.218424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d42f014f-aa52-4b40-a5c5-2a72cdbaf7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:25.282119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:02:25.295260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f014f-aa52-4b40-a5c5-2a72cdbaf7b7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:02:25.298828 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbbb4b-1add-40fb-9634-7bf8281f8a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:02:25.299599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbb4b-1add-40fb-9634-7bf8281f8a2b service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:25.299599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbb4b-1add-40fb-9634-7bf8281f8a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:25.300005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbb4b-1add-40fb-9634-7bf8281f8a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:25.308797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbbb4b-1add-40fb-9634-7bf8281f8a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:02:25.310215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbbb4b-1add-40fb-9634-7bf8281f8a2b service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:02:25.319833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 768/1536] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:02:27.272512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9b22-6ff1-48e6-8cce-9f81b9528264 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:27.273087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9b22-6ff1-48e6-8cce-9f81b9528264 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:27.273087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9b22-6ff1-48e6-8cce-9f81b9528264 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:27.274423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 17:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:02:27.280389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38c504-e0a5-4b55-9b3c-994a92cc5481 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:27.280941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38c504-e0a5-4b55-9b3c-994a92cc5481 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:27.281059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38c504-e0a5-4b55-9b3c-994a92cc5481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:27.301414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cd38c504-e0a5-4b55-9b3c-994a92cc5481 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:02:27.302617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cd38c504-e0a5-4b55-9b3c-994a92cc5481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:27.310329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 17:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:02:27.884990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed9b22-6ff1-48e6-8cce-9f81b9528264 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:02:27.886803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-baed9b22-6ff1-48e6-8cce-9f81b9528264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:02:27.900318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed9b22-6ff1-48e6-8cce-9f81b9528264 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:02:27.903819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcd9bc-e644-46d8-a7bb-5970c6579372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:02:27.904447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcd9bc-e644-46d8-a7bb-5970c6579372 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:02:27.905387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcd9bc-e644-46d8-a7bb-5970c6579372 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:02:27.905673 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcd9bc-e644-46d8-a7bb-5970c6579372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:02:27.914396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcd9bc-e644-46d8-a7bb-5970c6579372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:02:27.915844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcd9bc-e644-46d8-a7bb-5970c6579372 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:02:27.925140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 770/1539] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:02:37.296518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=11 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:02:37.920974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=8 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:03:58.738809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc543-1fac-433a-ac3a-5abc6acaa1f7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:58.739804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc543-1fac-433a-ac3a-5abc6acaa1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:58.740925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc543-1fac-433a-ac3a-5abc6acaa1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:58.774308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-84ffc543-1fac-433a-ac3a-5abc6acaa1f7 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:58.775831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-84ffc543-1fac-433a-ac3a-5abc6acaa1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:58.782301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ca527-da82-4a3e-8d6a-dbb12beaf38e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:58.782951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ca527-da82-4a3e-8d6a-dbb12beaf38e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:58.782951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ca527-da82-4a3e-8d6a-dbb12beaf38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:58.788246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 770/1540] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:58.791739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455dafa-cbc9-4c3f-9982-8c4bbba78dd1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:58.792267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455dafa-cbc9-4c3f-9982-8c4bbba78dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:58.793134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455dafa-cbc9-4c3f-9982-8c4bbba78dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:58.819339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cc6ca527-da82-4a3e-8d6a-dbb12beaf38e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:58.820592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cc6ca527-da82-4a3e-8d6a-dbb12beaf38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:58.827854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0455dafa-cbc9-4c3f-9982-8c4bbba78dd1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:58.830117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0455dafa-cbc9-4c3f-9982-8c4bbba78dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:58.840007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 771/1541] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:58.841312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80126a8a-7f59-468d-8c7b-6876a9e5c09f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:58.841601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80126a8a-7f59-468d-8c7b-6876a9e5c09f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:58.841882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80126a8a-7f59-468d-8c7b-6876a9e5c09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:58.850945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 771/1542] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:58.855237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3d96c-50b6-4378-9105-3069e6e574e6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:58.855769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3d96c-50b6-4378-9105-3069e6e574e6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:58.856059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3d96c-50b6-4378-9105-3069e6e574e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:58.887561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-80126a8a-7f59-468d-8c7b-6876a9e5c09f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:58.888786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-80126a8a-7f59-468d-8c7b-6876a9e5c09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:58.893099 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-afb3d96c-50b6-4378-9105-3069e6e574e6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:58.894283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-afb3d96c-50b6-4378-9105-3069e6e574e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:58.903729 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 772/1543] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:58.905423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56158cd-0f20-40cc-89a3-235190b986e5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:58.906280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56158cd-0f20-40cc-89a3-235190b986e5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:58.906583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56158cd-0f20-40cc-89a3-235190b986e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:58.909213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 772/1544] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:58.916501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5ba11-273b-480e-8e6e-836bcbe10297 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:58.916501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5ba11-273b-480e-8e6e-836bcbe10297 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:58.916501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5ba11-273b-480e-8e6e-836bcbe10297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:58.932313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6ec5ba11-273b-480e-8e6e-836bcbe10297 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:58.933604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6ec5ba11-273b-480e-8e6e-836bcbe10297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:58.935432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c56158cd-0f20-40cc-89a3-235190b986e5 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:58.936633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c56158cd-0f20-40cc-89a3-235190b986e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:58.943398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 773/1545] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:58.944944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29fad3-1816-49b6-ad27-ddeb07efba69 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:58.945331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29fad3-1816-49b6-ad27-ddeb07efba69 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:58.945722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29fad3-1816-49b6-ad27-ddeb07efba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:58.946166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 773/1546] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:58.947454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c4f51-2ac9-4f61-b9b4-23378919917c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:58.947689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c4f51-2ac9-4f61-b9b4-23378919917c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:58.947948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c4f51-2ac9-4f61-b9b4-23378919917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:58.971064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8f1c4f51-2ac9-4f61-b9b4-23378919917c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:58.972579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8f1c4f51-2ac9-4f61-b9b4-23378919917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:58.978229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-eb29fad3-1816-49b6-ad27-ddeb07efba69 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:58.979673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-eb29fad3-1816-49b6-ad27-ddeb07efba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:58.981784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 774/1547] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:58.983134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c4f51-2ac9-4f61-b9b4-23378919917c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:58.988630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 774/1548] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:58.989979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac545db-7ae0-4761-bbd7-5d364f32c05c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:58.990265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac545db-7ae0-4761-bbd7-5d364f32c05c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:58.990545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac545db-7ae0-4761-bbd7-5d364f32c05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:58.995989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c4f51-2ac9-4f61-b9b4-23378919917c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.000660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9428-1ec1-48dc-8e78-f62618150a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.001271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9428-1ec1-48dc-8e78-f62618150a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.001552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9428-1ec1-48dc-8e78-f62618150a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.001825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9428-1ec1-48dc-8e78-f62618150a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.002622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d9428-1ec1-48dc-8e78-f62618150a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:03:59.002935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d9428-1ec1-48dc-8e78-f62618150a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.003984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-994d9428-1ec1-48dc-8e78-f62618150a64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:03:59.003984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 18 17:03:59.003984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: Aug 18 17:03:59.004898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d9428-1ec1-48dc-8e78-f62618150a64 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.009533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-aac545db-7ae0-4761-bbd7-5d364f32c05c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:59.010736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-aac545db-7ae0-4761-bbd7-5d364f32c05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:59.022800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 775/1549] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:03:59.022800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9428-1ec1-48dc-8e78-f62618150a64 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.023118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 775/1550] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:59.023118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd166-1dd9-4548-8955-4da508aafb78 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.023118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd166-1dd9-4548-8955-4da508aafb78 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.023118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bd166-1dd9-4548-8955-4da508aafb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.032927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9428-1ec1-48dc-8e78-f62618150a64 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.041147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ee2bd166-1dd9-4548-8955-4da508aafb78 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:59.042364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ee2bd166-1dd9-4548-8955-4da508aafb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:59.047063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccde9d-8546-4115-a645-d820def2138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.047697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccde9d-8546-4115-a645-d820def2138a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.047981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccde9d-8546-4115-a645-d820def2138a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.048255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccde9d-8546-4115-a645-d820def2138a admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.048941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccde9d-8546-4115-a645-d820def2138a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:03:59.049247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccde9d-8546-4115-a645-d820def2138a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.050343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 776/1551] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:59.050851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccde9d-8546-4115-a645-d820def2138a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.051544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7049a-c3dc-4afe-a107-e5d471c8e266 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.051834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7049a-c3dc-4afe-a107-e5d471c8e266 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.052112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7049a-c3dc-4afe-a107-e5d471c8e266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.064208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 776/1552] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:03:59.065462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdac494-2c75-40ee-8386-2e0116bb6fbc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.065753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdac494-2c75-40ee-8386-2e0116bb6fbc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.066031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdac494-2c75-40ee-8386-2e0116bb6fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.076430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-31e7049a-c3dc-4afe-a107-e5d471c8e266 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:59.085128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-31e7049a-c3dc-4afe-a107-e5d471c8e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:59.086277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 777/1553] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:59.087392 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb0ada-d8e4-4384-b5e5-c73e4f1e56e0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.087681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb0ada-d8e4-4384-b5e5-c73e4f1e56e0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.087959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb0ada-d8e4-4384-b5e5-c73e4f1e56e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.088128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1cdac494-2c75-40ee-8386-2e0116bb6fbc None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:59.089723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1cdac494-2c75-40ee-8386-2e0116bb6fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:59.098430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 777/1554] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:59.099256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdac494-2c75-40ee-8386-2e0116bb6fbc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.109249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdac494-2c75-40ee-8386-2e0116bb6fbc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.109914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-81fb0ada-d8e4-4384-b5e5-c73e4f1e56e0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:59.111242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-81fb0ada-d8e4-4384-b5e5-c73e4f1e56e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:59.113903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f057e8b-820f-48aa-a9e2-386f14f9f4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.114504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f057e8b-820f-48aa-a9e2-386f14f9f4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.114786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f057e8b-820f-48aa-a9e2-386f14f9f4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.115064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f057e8b-820f-48aa-a9e2-386f14f9f4ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.115713 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f057e8b-820f-48aa-a9e2-386f14f9f4ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:03:59.116019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f057e8b-820f-48aa-a9e2-386f14f9f4ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.117645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f057e8b-820f-48aa-a9e2-386f14f9f4ea admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.119285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 778/1555] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:59.119928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb0ada-d8e4-4384-b5e5-c73e4f1e56e0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.129235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb0ada-d8e4-4384-b5e5-c73e4f1e56e0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.132714 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 778/1556] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:03:59.133515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f057e8b-820f-48aa-a9e2-386f14f9f4ea admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.141545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f48ea-5f37-42fe-9c1b-d49e8959fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.142131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f48ea-5f37-42fe-9c1b-d49e8959fc65 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.142412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f48ea-5f37-42fe-9c1b-d49e8959fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.142686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f48ea-5f37-42fe-9c1b-d49e8959fc65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.143339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f48ea-5f37-42fe-9c1b-d49e8959fc65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:03:59.143591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f057e8b-820f-48aa-a9e2-386f14f9f4ea admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.143719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f48ea-5f37-42fe-9c1b-d49e8959fc65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.145264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f48ea-5f37-42fe-9c1b-d49e8959fc65 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.148199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c604d-c392-46bd-97ee-d6d8d6ffcf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.148815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c604d-c392-46bd-97ee-d6d8d6ffcf34 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.149099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c604d-c392-46bd-97ee-d6d8d6ffcf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.149374 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c604d-c392-46bd-97ee-d6d8d6ffcf34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.149995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c604d-c392-46bd-97ee-d6d8d6ffcf34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.151881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c604d-c392-46bd-97ee-d6d8d6ffcf34 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.157729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 779/1557] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:03:59.158912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cccea-aa88-452c-b936-f72e7b52c502 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.159201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cccea-aa88-452c-b936-f72e7b52c502 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.159482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cccea-aa88-452c-b936-f72e7b52c502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.179328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e55cccea-aa88-452c-b936-f72e7b52c502 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:59.180590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e55cccea-aa88-452c-b936-f72e7b52c502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:59.189209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 780/1558] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:59.193883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 779/1559] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.193883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd736c-a42d-4d19-9099-c2b5b26ea93b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.193883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd736c-a42d-4d19-9099-c2b5b26ea93b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.193883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd736c-a42d-4d19-9099-c2b5b26ea93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.194347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cccea-aa88-452c-b936-f72e7b52c502 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.204971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cccea-aa88-452c-b936-f72e7b52c502 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.212022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ffcd736c-a42d-4d19-9099-c2b5b26ea93b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:03:59.213337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ffcd736c-a42d-4d19-9099-c2b5b26ea93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:03:59.264790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fde13-9b32-43ad-829a-0d72a43f431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.265404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fde13-9b32-43ad-829a-0d72a43f431d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.266211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fde13-9b32-43ad-829a-0d72a43f431d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.266515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fde13-9b32-43ad-829a-0d72a43f431d admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.267098 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fde13-9b32-43ad-829a-0d72a43f431d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.268111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-659fde13-9b32-43ad-829a-0d72a43f431d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:03:59.268111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 18 17:03:59.268111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: Aug 18 17:03:59.269381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fde13-9b32-43ad-829a-0d72a43f431d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.276856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 780/1560] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:03:59.276856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd736c-a42d-4d19-9099-c2b5b26ea93b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.286390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd736c-a42d-4d19-9099-c2b5b26ea93b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.291435 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae928374-fc29-4082-a30a-a06e458868d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.292050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae928374-fc29-4082-a30a-a06e458868d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.292341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae928374-fc29-4082-a30a-a06e458868d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.292652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae928374-fc29-4082-a30a-a06e458868d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.293307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae928374-fc29-4082-a30a-a06e458868d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:03:59.293640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae928374-fc29-4082-a30a-a06e458868d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.295240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae928374-fc29-4082-a30a-a06e458868d5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.301730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 781/1561] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.301730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fde13-9b32-43ad-829a-0d72a43f431d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.307354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 781/1562] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:03:59.308159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae928374-fc29-4082-a30a-a06e458868d5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.321000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae928374-fc29-4082-a30a-a06e458868d5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.363592 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fde13-9b32-43ad-829a-0d72a43f431d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.365615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:03:59.368688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883287a-0159-433f-8c34-c3f17cd73843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.369307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883287a-0159-433f-8c34-c3f17cd73843 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.369693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883287a-0159-433f-8c34-c3f17cd73843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.369975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883287a-0159-433f-8c34-c3f17cd73843 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.370878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883287a-0159-433f-8c34-c3f17cd73843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:03:59.371204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883287a-0159-433f-8c34-c3f17cd73843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.373203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883287a-0159-433f-8c34-c3f17cd73843 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.382094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:03:59.383264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17602f37-f3db-49ee-8021-24db987a40c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.383890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17602f37-f3db-49ee-8021-24db987a40c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.384203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17602f37-f3db-49ee-8021-24db987a40c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.384577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17602f37-f3db-49ee-8021-24db987a40c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.385280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17602f37-f3db-49ee-8021-24db987a40c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.394483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 782/1563] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:03:59.394698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17602f37-f3db-49ee-8021-24db987a40c4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.394790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883287a-0159-433f-8c34-c3f17cd73843 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.400064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883287a-0159-433f-8c34-c3f17cd73843 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.404842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c2dba-2d53-4713-bf04-9e7bd4fc24c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.405546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c2dba-2d53-4713-bf04-9e7bd4fc24c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.405836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c2dba-2d53-4713-bf04-9e7bd4fc24c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.406249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c2dba-2d53-4713-bf04-9e7bd4fc24c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.406950 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c2dba-2d53-4713-bf04-9e7bd4fc24c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.409077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c2dba-2d53-4713-bf04-9e7bd4fc24c7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.414653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 782/1564] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.417440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17602f37-f3db-49ee-8021-24db987a40c4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.436886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 783/1565] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.441397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c2dba-2d53-4713-bf04-9e7bd4fc24c7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.482873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17602f37-f3db-49ee-8021-24db987a40c4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.504411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c2dba-2d53-4713-bf04-9e7bd4fc24c7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.508999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b37bd-9b9e-4d97-a38a-f4608bc7f6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.509665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b37bd-9b9e-4d97-a38a-f4608bc7f6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.509911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b37bd-9b9e-4d97-a38a-f4608bc7f6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.510152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b37bd-9b9e-4d97-a38a-f4608bc7f6f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.510796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b37bd-9b9e-4d97-a38a-f4608bc7f6f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:03:59.511097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b37bd-9b9e-4d97-a38a-f4608bc7f6f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.512718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b37bd-9b9e-4d97-a38a-f4608bc7f6f3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.524857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 784/1566] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:03:59.532611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b37bd-9b9e-4d97-a38a-f4608bc7f6f3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.542160 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b37bd-9b9e-4d97-a38a-f4608bc7f6f3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.542339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e68484-6c47-4ad0-9bd9-b114fea22dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.542788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e68484-6c47-4ad0-9bd9-b114fea22dfb admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.543152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e68484-6c47-4ad0-9bd9-b114fea22dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.543433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e68484-6c47-4ad0-9bd9-b114fea22dfb admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.544064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e68484-6c47-4ad0-9bd9-b114fea22dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.545138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-07e68484-6c47-4ad0-9bd9-b114fea22dfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:03:59.545138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 18 17:03:59.545138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: Aug 18 17:03:59.546388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e68484-6c47-4ad0-9bd9-b114fea22dfb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.546792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474202e9-9b47-484b-8c99-b007d6fc108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.547380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474202e9-9b47-484b-8c99-b007d6fc108b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.547654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474202e9-9b47-484b-8c99-b007d6fc108b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.547923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474202e9-9b47-484b-8c99-b007d6fc108b admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.548595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474202e9-9b47-484b-8c99-b007d6fc108b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:03:59.549029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474202e9-9b47-484b-8c99-b007d6fc108b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.550597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474202e9-9b47-484b-8c99-b007d6fc108b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.564484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 785/1567] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:03:59.568881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 783/1568] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.569423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474202e9-9b47-484b-8c99-b007d6fc108b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.572952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e68484-6c47-4ad0-9bd9-b114fea22dfb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.581075 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474202e9-9b47-484b-8c99-b007d6fc108b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.583668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e68484-6c47-4ad0-9bd9-b114fea22dfb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.585764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4601c-d702-408d-8fa1-379b3bf15ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.586367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4601c-d702-408d-8fa1-379b3bf15ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.586648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4601c-d702-408d-8fa1-379b3bf15ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.587023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4601c-d702-408d-8fa1-379b3bf15ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.587556 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4601c-d702-408d-8fa1-379b3bf15ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.588441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aab75-d8c1-49e2-a298-e9643978cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.590532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4601c-d702-408d-8fa1-379b3bf15ba2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.590908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aab75-d8c1-49e2-a298-e9643978cbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.591238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aab75-d8c1-49e2-a298-e9643978cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.591484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aab75-d8c1-49e2-a298-e9643978cbe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.592105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aab75-d8c1-49e2-a298-e9643978cbe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.594052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623aab75-d8c1-49e2-a298-e9643978cbe2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.614794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 786/1569] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.614794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4601c-d702-408d-8fa1-379b3bf15ba2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.623104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4601c-d702-408d-8fa1-379b3bf15ba2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.630531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 784/1570] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.630693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6410f9-2281-435d-922d-3d264895502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.630818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aab75-d8c1-49e2-a298-e9643978cbe2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.630914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6410f9-2281-435d-922d-3d264895502b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.630914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6410f9-2281-435d-922d-3d264895502b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.630914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6410f9-2281-435d-922d-3d264895502b admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.630914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6410f9-2281-435d-922d-3d264895502b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.631862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6410f9-2281-435d-922d-3d264895502b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.663118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 787/1571] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.663118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6410f9-2281-435d-922d-3d264895502b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.679279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:03:59.696700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aab75-d8c1-49e2-a298-e9643978cbe2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.730440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6410f9-2281-435d-922d-3d264895502b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.735710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea83c6-d772-44a2-85f7-9ffcb0765857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.736377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea83c6-d772-44a2-85f7-9ffcb0765857 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.736701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea83c6-d772-44a2-85f7-9ffcb0765857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.736974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea83c6-d772-44a2-85f7-9ffcb0765857 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.737651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea83c6-d772-44a2-85f7-9ffcb0765857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.739619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea83c6-d772-44a2-85f7-9ffcb0765857 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.765419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 788/1572] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.765642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf88bd6-b5aa-4db0-bcab-292863518e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.765642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf88bd6-b5aa-4db0-bcab-292863518e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.765945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea83c6-d772-44a2-85f7-9ffcb0765857 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.766037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf88bd6-b5aa-4db0-bcab-292863518e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.766037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf88bd6-b5aa-4db0-bcab-292863518e6b admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.766037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf88bd6-b5aa-4db0-bcab-292863518e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.767238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf88bd6-b5aa-4db0-bcab-292863518e6b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.773137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea83c6-d772-44a2-85f7-9ffcb0765857 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.778368 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c6c9f-d4d9-4f2e-b762-785d0c056dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.779036 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6c9f-d4d9-4f2e-b762-785d0c056dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.779320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6c9f-d4d9-4f2e-b762-785d0c056dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.779649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6c9f-d4d9-4f2e-b762-785d0c056dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.780316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c6c9f-d4d9-4f2e-b762-785d0c056dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.782399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c6c9f-d4d9-4f2e-b762-785d0c056dd1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.787869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:03:59.788800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 785/1573] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.789492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf88bd6-b5aa-4db0-bcab-292863518e6b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.800830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf88bd6-b5aa-4db0-bcab-292863518e6b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.806124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d9449-cd96-417a-81a1-8870d73d3ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.806806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d9449-cd96-417a-81a1-8870d73d3ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.807033 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d9449-cd96-417a-81a1-8870d73d3ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.807307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d9449-cd96-417a-81a1-8870d73d3ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.807928 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d9449-cd96-417a-81a1-8870d73d3ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.809865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d9449-cd96-417a-81a1-8870d73d3ad2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.817262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 789/1574] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.817262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c6c9f-d4d9-4f2e-b762-785d0c056dd1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.840339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 786/1575] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.841272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d9449-cd96-417a-81a1-8870d73d3ad2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.887461 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c6c9f-d4d9-4f2e-b762-785d0c056dd1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.903417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d9449-cd96-417a-81a1-8870d73d3ad2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.908065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062105fc-7160-4cfd-9129-ffbc66ba1872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.908708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062105fc-7160-4cfd-9129-ffbc66ba1872 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.908999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062105fc-7160-4cfd-9129-ffbc66ba1872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.909272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062105fc-7160-4cfd-9129-ffbc66ba1872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.909919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062105fc-7160-4cfd-9129-ffbc66ba1872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.911507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062105fc-7160-4cfd-9129-ffbc66ba1872 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.922222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 787/1576] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:03:59.925413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062105fc-7160-4cfd-9129-ffbc66ba1872 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.934360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062105fc-7160-4cfd-9129-ffbc66ba1872 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.939527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbb89d-c47e-41ff-9696-8f2850ec179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.940164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbb89d-c47e-41ff-9696-8f2850ec179a admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.940442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbb89d-c47e-41ff-9696-8f2850ec179a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.940857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbb89d-c47e-41ff-9696-8f2850ec179a admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.941473 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbb89d-c47e-41ff-9696-8f2850ec179a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.942902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0e0d-bb85-4f21-aa6f-aa6b4e15c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.943359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbb89d-c47e-41ff-9696-8f2850ec179a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.943512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0e0d-bb85-4f21-aa6f-aa6b4e15c8be admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.943796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0e0d-bb85-4f21-aa6f-aa6b4e15c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.944074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0e0d-bb85-4f21-aa6f-aa6b4e15c8be admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.944755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0e0d-bb85-4f21-aa6f-aa6b4e15c8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.946349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0e0d-bb85-4f21-aa6f-aa6b4e15c8be admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.956526 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 790/1577] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:03:59.957585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0e0d-bb85-4f21-aa6f-aa6b4e15c8be admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.968319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 788/1578] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:03:59.968319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbb89d-c47e-41ff-9696-8f2850ec179a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:03:59.970531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0e0d-bb85-4f21-aa6f-aa6b4e15c8be admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.975193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9a2ad-2c26-44ce-b933-694d1f226798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.975825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a2ad-2c26-44ce-b933-694d1f226798 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.975938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbb89d-c47e-41ff-9696-8f2850ec179a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:03:59.976102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a2ad-2c26-44ce-b933-694d1f226798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.976404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a2ad-2c26-44ce-b933-694d1f226798 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.977056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9a2ad-2c26-44ce-b933-694d1f226798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.979422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9a2ad-2c26-44ce-b933-694d1f226798 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:03:59.980947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97e268-0807-4d4f-bf58-bfdf94934e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:03:59.981547 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97e268-0807-4d4f-bf58-bfdf94934e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:03:59.981831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97e268-0807-4d4f-bf58-bfdf94934e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:03:59.982108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97e268-0807-4d4f-bf58-bfdf94934e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:03:59.982749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97e268-0807-4d4f-bf58-bfdf94934e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:03:59.984862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97e268-0807-4d4f-bf58-bfdf94934e0a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.000972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 789/1579] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.001652 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 791/1580] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:03:59 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:00.002389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97e268-0807-4d4f-bf58-bfdf94934e0a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.002540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9a2ad-2c26-44ce-b933-694d1f226798 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.011982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9a2ad-2c26-44ce-b933-694d1f226798 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.012142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97e268-0807-4d4f-bf58-bfdf94934e0a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.017063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd781b-b1af-4e93-b780-ceafe3c71058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.017242 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac8b7-6745-47d0-bd99-9ac2737374e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.017681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd781b-b1af-4e93-b780-ceafe3c71058 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.017872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac8b7-6745-47d0-bd99-9ac2737374e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.017996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd781b-b1af-4e93-b780-ceafe3c71058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.018140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac8b7-6745-47d0-bd99-9ac2737374e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.018275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd781b-b1af-4e93-b780-ceafe3c71058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.018429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac8b7-6745-47d0-bd99-9ac2737374e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.018841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd781b-b1af-4e93-b780-ceafe3c71058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.019022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ac8b7-6745-47d0-bd99-9ac2737374e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.020415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd781b-b1af-4e93-b780-ceafe3c71058 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.020953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ac8b7-6745-47d0-bd99-9ac2737374e7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.030379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 790/1581] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.034343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd781b-b1af-4e93-b780-ceafe3c71058 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.041982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd781b-b1af-4e93-b780-ceafe3c71058 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.046584 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f48448-ed41-4809-97bb-74cfe266d271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.047226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f48448-ed41-4809-97bb-74cfe266d271 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.047506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f48448-ed41-4809-97bb-74cfe266d271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.047778 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f48448-ed41-4809-97bb-74cfe266d271 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.048146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 792/1582] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:00 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:00.048400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f48448-ed41-4809-97bb-74cfe266d271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.049113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac8b7-6745-47d0-bd99-9ac2737374e7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.050348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f48448-ed41-4809-97bb-74cfe266d271 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.059606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac8b7-6745-47d0-bd99-9ac2737374e7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.065039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5fbd7-76cb-447f-98b7-51f42bbcc2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.065649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5fbd7-76cb-447f-98b7-51f42bbcc2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.065947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5fbd7-76cb-447f-98b7-51f42bbcc2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.066213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5fbd7-76cb-447f-98b7-51f42bbcc2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.066523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:00.066862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5fbd7-76cb-447f-98b7-51f42bbcc2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.068915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5fbd7-76cb-447f-98b7-51f42bbcc2f3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.076298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 791/1583] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:00 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:00.076298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f48448-ed41-4809-97bb-74cfe266d271 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.083867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 793/1584] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.083867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5fbd7-76cb-447f-98b7-51f42bbcc2f3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.089033 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f48448-ed41-4809-97bb-74cfe266d271 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.091669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5fbd7-76cb-447f-98b7-51f42bbcc2f3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.093678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe28946-c397-481d-a988-3f28ffe89f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.094337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe28946-c397-481d-a988-3f28ffe89f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.094627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe28946-c397-481d-a988-3f28ffe89f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.094900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe28946-c397-481d-a988-3f28ffe89f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.095557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe28946-c397-481d-a988-3f28ffe89f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.096760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c0d9-843b-46c8-be44-a956bbde19c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.097208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe28946-c397-481d-a988-3f28ffe89f94 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.097364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c0d9-843b-46c8-be44-a956bbde19c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.097648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c0d9-843b-46c8-be44-a956bbde19c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.097946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c0d9-843b-46c8-be44-a956bbde19c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.098580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c0d9-843b-46c8-be44-a956bbde19c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.100177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c0d9-843b-46c8-be44-a956bbde19c7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.108237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 792/1585] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.109083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe28946-c397-481d-a988-3f28ffe89f94 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.111309 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 794/1586] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.112258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c0d9-843b-46c8-be44-a956bbde19c7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.120797 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe28946-c397-481d-a988-3f28ffe89f94 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.121817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c0d9-843b-46c8-be44-a956bbde19c7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.126106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b56dee-88f3-4759-adbd-8788710a1e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.126708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b56dee-88f3-4759-adbd-8788710a1e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.126934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7982c-8c4d-4613-b555-5a4621a72430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.127050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b56dee-88f3-4759-adbd-8788710a1e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.127247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b56dee-88f3-4759-adbd-8788710a1e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.127518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7982c-8c4d-4613-b555-5a4621a72430 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.127805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7982c-8c4d-4613-b555-5a4621a72430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.127914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b56dee-88f3-4759-adbd-8788710a1e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.128085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7982c-8c4d-4613-b555-5a4621a72430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.128757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7982c-8c4d-4613-b555-5a4621a72430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.129483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b56dee-88f3-4759-adbd-8788710a1e09 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.130338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7982c-8c4d-4613-b555-5a4621a72430 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.140028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 793/1587] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.144064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 795/1588] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.144222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b56dee-88f3-4759-adbd-8788710a1e09 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.144342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7982c-8c4d-4613-b555-5a4621a72430 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.153976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7982c-8c4d-4613-b555-5a4621a72430 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.154240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b56dee-88f3-4759-adbd-8788710a1e09 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.159033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6802d-33ec-43bc-8152-0b9b45f17f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.159261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb06ac-df16-40f4-96a4-89d8c88e22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.159625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6802d-33ec-43bc-8152-0b9b45f17f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.159855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb06ac-df16-40f4-96a4-89d8c88e22bc admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.159962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6802d-33ec-43bc-8152-0b9b45f17f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.160139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb06ac-df16-40f4-96a4-89d8c88e22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.160245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6802d-33ec-43bc-8152-0b9b45f17f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.160414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb06ac-df16-40f4-96a4-89d8c88e22bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.160830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6802d-33ec-43bc-8152-0b9b45f17f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.161088 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb06ac-df16-40f4-96a4-89d8c88e22bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.162416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6802d-33ec-43bc-8152-0b9b45f17f1f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.162660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb06ac-df16-40f4-96a4-89d8c88e22bc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.173949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 796/1589] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.177834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 794/1590] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.177834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb06ac-df16-40f4-96a4-89d8c88e22bc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.178052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6802d-33ec-43bc-8152-0b9b45f17f1f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.185554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb06ac-df16-40f4-96a4-89d8c88e22bc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.188187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6802d-33ec-43bc-8152-0b9b45f17f1f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.190680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd6220-d202-454e-8314-7c4c690cda61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.191333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd6220-d202-454e-8314-7c4c690cda61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.191619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd6220-d202-454e-8314-7c4c690cda61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.191899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd6220-d202-454e-8314-7c4c690cda61 admin admin] PATH_INFO: `/v3/projects/3dcfef1a11494761b9932b9780fd5e4b/users/706d3e83eec04ab7ae4f6abfcdce2cf8/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.192809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349693b9-752d-402d-8da8-ce9eabac16de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.193400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349693b9-752d-402d-8da8-ce9eabac16de admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.193683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349693b9-752d-402d-8da8-ce9eabac16de admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.193969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349693b9-752d-402d-8da8-ce9eabac16de admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.194606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349693b9-752d-402d-8da8-ce9eabac16de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.196243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349693b9-752d-402d-8da8-ce9eabac16de admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.206956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:00.207204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 797/1591] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.208822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349693b9-752d-402d-8da8-ce9eabac16de admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.209029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd6220-d202-454e-8314-7c4c690cda61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcfef1a11494761b9932b9780fd5e4b, user_id=706d3e83eec04ab7ae4f6abfcdce2cf8, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.212194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd6220-d202-454e-8314-7c4c690cda61 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.220849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349693b9-752d-402d-8da8-ce9eabac16de admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.225977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 795/1592] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:00 2022] PUT /identity/v3/projects/3dcfef1a11494761b9932b9780fd5e4b/users/706d3e83eec04ab7ae4f6abfcdce2cf8/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:00.226799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd6220-d202-454e-8314-7c4c690cda61 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.283732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fb757-bcee-4452-8798-b3a79a6fbf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.284404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fb757-bcee-4452-8798-b3a79a6fbf8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.284716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fb757-bcee-4452-8798-b3a79a6fbf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.284992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fb757-bcee-4452-8798-b3a79a6fbf8b admin admin] PATH_INFO: `/v3/projects/81331876bf0841e3a8de9bb649595610/users/368cddc3968c4c39b7ca05c500872b45/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.290839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd6220-d202-454e-8314-7c4c690cda61 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.295689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82266fad-f9ce-4f63-962c-065118fc00b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.296311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82266fad-f9ce-4f63-962c-065118fc00b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.296629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82266fad-f9ce-4f63-962c-065118fc00b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.296935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82266fad-f9ce-4f63-962c-065118fc00b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.297591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82266fad-f9ce-4f63-962c-065118fc00b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.299256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82266fad-f9ce-4f63-962c-065118fc00b8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.300201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230fb757-bcee-4452-8798-b3a79a6fbf8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81331876bf0841e3a8de9bb649595610, user_id=368cddc3968c4c39b7ca05c500872b45, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.301271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-230fb757-bcee-4452-8798-b3a79a6fbf8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:04:00.301271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 18 17:04:00.301271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: Aug 18 17:04:00.303161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230fb757-bcee-4452-8798-b3a79a6fbf8b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.309692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 796/1593] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.310578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82266fad-f9ce-4f63-962c-065118fc00b8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.317569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 798/1594] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:00 2022] PUT /identity/v3/projects/81331876bf0841e3a8de9bb649595610/users/368cddc3968c4c39b7ca05c500872b45/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:00.318424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fb757-bcee-4452-8798-b3a79a6fbf8b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.325277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82266fad-f9ce-4f63-962c-065118fc00b8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.379203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fb757-bcee-4452-8798-b3a79a6fbf8b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.383882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101ea2b-fa62-4cf9-b00c-3a1e7d22cae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.384529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101ea2b-fa62-4cf9-b00c-3a1e7d22cae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.384815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101ea2b-fa62-4cf9-b00c-3a1e7d22cae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.385091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101ea2b-fa62-4cf9-b00c-3a1e7d22cae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.385615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279d5c-c8aa-4b82-8752-7ea579f744be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.385739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101ea2b-fa62-4cf9-b00c-3a1e7d22cae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.386280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279d5c-c8aa-4b82-8752-7ea579f744be admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.386560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279d5c-c8aa-4b82-8752-7ea579f744be admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.386836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3279d5c-c8aa-4b82-8752-7ea579f744be admin admin] PATH_INFO: `/v3/projects/51c0ac563c7e4963a2b6fc82147c2cf4/users/ea56e67708a4462085ef23115b7676a4/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.387353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101ea2b-fa62-4cf9-b00c-3a1e7d22cae6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.402248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 799/1595] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.402248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101ea2b-fa62-4cf9-b00c-3a1e7d22cae6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.403995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3279d5c-c8aa-4b82-8752-7ea579f744be admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c0ac563c7e4963a2b6fc82147c2cf4, user_id=ea56e67708a4462085ef23115b7676a4, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.406780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3279d5c-c8aa-4b82-8752-7ea579f744be admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.412023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101ea2b-fa62-4cf9-b00c-3a1e7d22cae6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.416975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98649d40-d03f-48ac-bd20-5115be9f7d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.417612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98649d40-d03f-48ac-bd20-5115be9f7d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.417875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98649d40-d03f-48ac-bd20-5115be9f7d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.418148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98649d40-d03f-48ac-bd20-5115be9f7d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.418782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98649d40-d03f-48ac-bd20-5115be9f7d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.419945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 797/1596] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:00 2022] PUT /identity/v3/projects/51c0ac563c7e4963a2b6fc82147c2cf4/users/ea56e67708a4462085ef23115b7676a4/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:00.420362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98649d40-d03f-48ac-bd20-5115be9f7d09 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.420764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279d5c-c8aa-4b82-8752-7ea579f744be admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.432105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 800/1597] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.432997 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98649d40-d03f-48ac-bd20-5115be9f7d09 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.443415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:00.444014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98649d40-d03f-48ac-bd20-5115be9f7d09 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.486438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3279d5c-c8aa-4b82-8752-7ea579f744be admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.491481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a15a81-9c77-4387-9a9d-9a306a914a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.492357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a15a81-9c77-4387-9a9d-9a306a914a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.492671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a15a81-9c77-4387-9a9d-9a306a914a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.492951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a15a81-9c77-4387-9a9d-9a306a914a4a admin admin] PATH_INFO: `/v3/projects/bbe3556e449846fe877631a876d7c89c/users/2ebc8b562fc84077b9aec4f12cb818ba/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.504384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc712b60-0d5c-4609-b9f4-6c3168dc3ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.505038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc712b60-0d5c-4609-b9f4-6c3168dc3ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.505324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc712b60-0d5c-4609-b9f4-6c3168dc3ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.505605 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc712b60-0d5c-4609-b9f4-6c3168dc3ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.506249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc712b60-0d5c-4609-b9f4-6c3168dc3ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.507849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc712b60-0d5c-4609-b9f4-6c3168dc3ed2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.508498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a15a81-9c77-4387-9a9d-9a306a914a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe3556e449846fe877631a876d7c89c, user_id=2ebc8b562fc84077b9aec4f12cb818ba, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.511800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a15a81-9c77-4387-9a9d-9a306a914a4a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.518944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 801/1598] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:00.520120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a79b69-d167-4e88-bc2a-acf8bbd4c4d8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.520412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a79b69-d167-4e88-bc2a-acf8bbd4c4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.520736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a79b69-d167-4e88-bc2a-acf8bbd4c4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.527825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 798/1599] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:00 2022] PUT /identity/v3/projects/bbe3556e449846fe877631a876d7c89c/users/2ebc8b562fc84077b9aec4f12cb818ba/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:00.528489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:00.528677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a15a81-9c77-4387-9a9d-9a306a914a4a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.557579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d1a79b69-d167-4e88-bc2a-acf8bbd4c4d8 None None] MFA Rules not processed for user `706d3e83eec04ab7ae4f6abfcdce2cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:00.558793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d1a79b69-d167-4e88-bc2a-acf8bbd4c4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:00.595157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a15a81-9c77-4387-9a9d-9a306a914a4a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.599832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff257c-e251-4809-8d39-0ac9b901f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.600519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff257c-e251-4809-8d39-0ac9b901f34d admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.600806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff257c-e251-4809-8d39-0ac9b901f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.601086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff257c-e251-4809-8d39-0ac9b901f34d admin admin] PATH_INFO: `/v3/projects/18ddcf0d99694f4daa53d9232e2c25fe/users/bf1495a3fc4c44e2a323d930c6a39447/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.617621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff257c-e251-4809-8d39-0ac9b901f34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ddcf0d99694f4daa53d9232e2c25fe, user_id=bf1495a3fc4c44e2a323d930c6a39447, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.620279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff257c-e251-4809-8d39-0ac9b901f34d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.624014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 802/1600] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:00.625653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23be2d-e91e-48ce-9618-ce9fb6ecec62 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.626110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23be2d-e91e-48ce-9618-ce9fb6ecec62 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.626445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23be2d-e91e-48ce-9618-ce9fb6ecec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.644209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 799/1601] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:00 2022] PUT /identity/v3/projects/18ddcf0d99694f4daa53d9232e2c25fe/users/bf1495a3fc4c44e2a323d930c6a39447/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:00.644209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff257c-e251-4809-8d39-0ac9b901f34d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.657944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ce23be2d-e91e-48ce-9618-ce9fb6ecec62 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:00.659186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ce23be2d-e91e-48ce-9618-ce9fb6ecec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:00.719780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff257c-e251-4809-8d39-0ac9b901f34d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.725596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 803/1602] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:00.726369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779298e3-4829-4cc7-a8bb-d0949463c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.727171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779298e3-4829-4cc7-a8bb-d0949463c64c admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.727315 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9b7bf-a9f1-4db8-a5c4-873673cae978 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.727586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9b7bf-a9f1-4db8-a5c4-873673cae978 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.727705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779298e3-4829-4cc7-a8bb-d0949463c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.727866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9b7bf-a9f1-4db8-a5c4-873673cae978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.728163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779298e3-4829-4cc7-a8bb-d0949463c64c admin admin] PATH_INFO: `/v3/projects/98c9936461d14064953dbe8bb6458391/users/bd9569a742014d079ca605b61255ad14/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.748837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779298e3-4829-4cc7-a8bb-d0949463c64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c9936461d14064953dbe8bb6458391, user_id=bd9569a742014d079ca605b61255ad14, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.751625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779298e3-4829-4cc7-a8bb-d0949463c64c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.756551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e2f9b7bf-a9f1-4db8-a5c4-873673cae978 None None] MFA Rules not processed for user `ea56e67708a4462085ef23115b7676a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:00.757881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e2f9b7bf-a9f1-4db8-a5c4-873673cae978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:00.765219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 800/1603] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:00 2022] PUT /identity/v3/projects/98c9936461d14064953dbe8bb6458391/users/bd9569a742014d079ca605b61255ad14/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:00.766639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779298e3-4829-4cc7-a8bb-d0949463c64c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.777121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:00.834082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779298e3-4829-4cc7-a8bb-d0949463c64c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.836994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 804/1604] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:00.837719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9b7bf-a9f1-4db8-a5c4-873673cae978 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.840936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07103a17-813e-43d3-b937-5ba8a9676ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.841606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07103a17-813e-43d3-b937-5ba8a9676ada admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.841893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07103a17-813e-43d3-b937-5ba8a9676ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.842177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07103a17-813e-43d3-b937-5ba8a9676ada admin admin] PATH_INFO: `/v3/projects/147476b7d79a4f55ac9096f2cfa5c78c/users/53327160ebb04585b414ad1571259834/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.849562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9b7bf-a9f1-4db8-a5c4-873673cae978 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:00.855148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4b4cc-db74-4988-9022-b1c9b7e9bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:00.855825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4b4cc-db74-4988-9022-b1c9b7e9bf17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.856108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4b4cc-db74-4988-9022-b1c9b7e9bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.856489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4b4cc-db74-4988-9022-b1c9b7e9bf17 admin admin] PATH_INFO: `/v3/projects/a1ff68a5c2bf4c5c85c9ed415f710f12/users/28addacbb72f4971acf2b61f904af131/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.858633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07103a17-813e-43d3-b937-5ba8a9676ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=147476b7d79a4f55ac9096f2cfa5c78c, user_id=53327160ebb04585b414ad1571259834, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.861434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07103a17-813e-43d3-b937-5ba8a9676ada admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.875604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4b4cc-db74-4988-9022-b1c9b7e9bf17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ff68a5c2bf4c5c85c9ed415f710f12, user_id=28addacbb72f4971acf2b61f904af131, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:00.877244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 801/1605] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:00 2022] PUT /identity/v3/projects/147476b7d79a4f55ac9096f2cfa5c78c/users/53327160ebb04585b414ad1571259834/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:00.878647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4b4cc-db74-4988-9022-b1c9b7e9bf17 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:00.882448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1637582-e986-4eaa-825a-173de6f50c88 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.882817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1637582-e986-4eaa-825a-173de6f50c88 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.883205 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1637582-e986-4eaa-825a-173de6f50c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.890311 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:00.895841 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 805/1606] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:00 2022] PUT /identity/v3/projects/a1ff68a5c2bf4c5c85c9ed415f710f12/users/28addacbb72f4971acf2b61f904af131/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:00.897343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9396b-0257-4b81-8df1-7c871683f3b0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.898087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9396b-0257-4b81-8df1-7c871683f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.898307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9396b-0257-4b81-8df1-7c871683f3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.917108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b1637582-e986-4eaa-825a-173de6f50c88 None None] MFA Rules not processed for user `2ebc8b562fc84077b9aec4f12cb818ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:00.918339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b1637582-e986-4eaa-825a-173de6f50c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:00.926079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b9e9396b-0257-4b81-8df1-7c871683f3b0 None None] MFA Rules not processed for user `bf1495a3fc4c44e2a323d930c6a39447`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:00.927268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b9e9396b-0257-4b81-8df1-7c871683f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:00.983412 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 802/1607] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:00.984768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332f97-0a53-421a-bc7b-f00d0e5edb9c None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:00.985119 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332f97-0a53-421a-bc7b-f00d0e5edb9c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:00.985488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332f97-0a53-421a-bc7b-f00d0e5edb9c None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:00.987300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 803/1608] 10.222.0.81 () {54 vars in 962 bytes} [Thu Aug 18 17:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:04:00.987598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63332f97-0a53-421a-bc7b-f00d0e5edb9c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:00.989320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-63332f97-0a53-421a-bc7b-f00d0e5edb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:01.006355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 806/1609] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:01.007775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532d87-5fd9-4da6-9f6a-5642c6660558 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.008164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532d87-5fd9-4da6-9f6a-5642c6660558 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.008573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532d87-5fd9-4da6-9f6a-5642c6660558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.037984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f5532d87-5fd9-4da6-9f6a-5642c6660558 None None] MFA Rules not processed for user `bd9569a742014d079ca605b61255ad14`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:01.039208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f5532d87-5fd9-4da6-9f6a-5642c6660558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:01.054651 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63332f97-0a53-421a-bc7b-f00d0e5edb9c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.058898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debceabf-5ceb-49c3-ab87-a97ebfc91be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.059652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debceabf-5ceb-49c3-ab87-a97ebfc91be5 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.060055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debceabf-5ceb-49c3-ab87-a97ebfc91be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.060403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debceabf-5ceb-49c3-ab87-a97ebfc91be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.099513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:01.109890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 807/1610] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:01.109890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6b989-6b95-46a3-9b95-b396000a2be1 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.109890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6b989-6b95-46a3-9b95-b396000a2be1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.109890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6b989-6b95-46a3-9b95-b396000a2be1 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.111228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 808/1611] 10.222.0.81 () {54 vars in 962 bytes} [Thu Aug 18 17:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:04:01.112417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8876b-0cfc-42ea-9831-6c5ccd7ec9ff None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.112721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8876b-0cfc-42ea-9831-6c5ccd7ec9ff None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.113000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8876b-0cfc-42ea-9831-6c5ccd7ec9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.134384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debceabf-5ceb-49c3-ab87-a97ebfc91be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.134596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a5e8876b-0cfc-42ea-9831-6c5ccd7ec9ff None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:01.135782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a5e8876b-0cfc-42ea-9831-6c5ccd7ec9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:01.136061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debceabf-5ceb-49c3-ab87-a97ebfc91be5 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.145107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 809/1612] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:01.146429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906155c7-e96f-4f8f-96a3-f728d30020ad None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.146784 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906155c7-e96f-4f8f-96a3-f728d30020ad None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.147143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906155c7-e96f-4f8f-96a3-f728d30020ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.148084 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 804/1613] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:01.148982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debceabf-5ceb-49c3-ab87-a97ebfc91be5 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.158952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debceabf-5ceb-49c3-ab87-a97ebfc91be5 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.163951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ae093-3f47-4369-a5aa-03bc3ad4a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.164595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ae093-3f47-4369-a5aa-03bc3ad4a038 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.164882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ae093-3f47-4369-a5aa-03bc3ad4a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.165162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ae093-3f47-4369-a5aa-03bc3ad4a038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.165822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ae093-3f47-4369-a5aa-03bc3ad4a038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.167752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ae093-3f47-4369-a5aa-03bc3ad4a038 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.168165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-906155c7-e96f-4f8f-96a3-f728d30020ad None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:01.169613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-906155c7-e96f-4f8f-96a3-f728d30020ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:01.182537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 810/1614] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:01.182537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6385a14-9498-4faf-80de-5a08056510e1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.182537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6385a14-9498-4faf-80de-5a08056510e1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.182537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6385a14-9498-4faf-80de-5a08056510e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.198297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 805/1615] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:01 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:01.202097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ae093-3f47-4369-a5aa-03bc3ad4a038 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.227061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b6385a14-9498-4faf-80de-5a08056510e1 None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:01.228114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b6385a14-9498-4faf-80de-5a08056510e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:01.279301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ae093-3f47-4369-a5aa-03bc3ad4a038 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.284654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bef23-27dd-4a38-a567-7da76d3bb70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.285281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bef23-27dd-4a38-a567-7da76d3bb70e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.285704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bef23-27dd-4a38-a567-7da76d3bb70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.286048 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bef23-27dd-4a38-a567-7da76d3bb70e admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.286688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bef23-27dd-4a38-a567-7da76d3bb70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.288727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bef23-27dd-4a38-a567-7da76d3bb70e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.292240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:01.316860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 811/1616] 10.222.0.81 () {58 vars in 1059 bytes} [Thu Aug 18 17:04:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:01.318108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2755b-5e31-416d-a89a-e1f5a3721746 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.318402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2755b-5e31-416d-a89a-e1f5a3721746 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.318678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2755b-5e31-416d-a89a-e1f5a3721746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.337626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 806/1617] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:01 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:01.337626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bef23-27dd-4a38-a567-7da76d3bb70e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.339879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-dba2755b-5e31-416d-a89a-e1f5a3721746 None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:01.341157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dba2755b-5e31-416d-a89a-e1f5a3721746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:01.402386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bef23-27dd-4a38-a567-7da76d3bb70e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.407712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787facf4-49b3-4f35-8e32-1d614cf85ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.408415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787facf4-49b3-4f35-8e32-1d614cf85ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.408799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787facf4-49b3-4f35-8e32-1d614cf85ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.409161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787facf4-49b3-4f35-8e32-1d614cf85ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.429025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 812/1618] 10.222.0.81 () {58 vars in 1059 bytes} [Thu Aug 18 17:04:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:01.430260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2755b-5e31-416d-a89a-e1f5a3721746 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.441073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2755b-5e31-416d-a89a-e1f5a3721746 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.445177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7a583-6e54-4a13-ba24-71354b06ffcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.445919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a583-6e54-4a13-ba24-71354b06ffcc service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.446201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a583-6e54-4a13-ba24-71354b06ffcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.446680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7a583-6e54-4a13-ba24-71354b06ffcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.470816 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:01.490433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787facf4-49b3-4f35-8e32-1d614cf85ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.492532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787facf4-49b3-4f35-8e32-1d614cf85ec3 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.504613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 807/1619] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:01.505303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787facf4-49b3-4f35-8e32-1d614cf85ec3 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.515496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787facf4-49b3-4f35-8e32-1d614cf85ec3 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.520323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511a22b-31aa-43e5-8b4e-fbf3d3232f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.521040 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511a22b-31aa-43e5-8b4e-fbf3d3232f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.521419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511a22b-31aa-43e5-8b4e-fbf3d3232f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.521794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511a22b-31aa-43e5-8b4e-fbf3d3232f44 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.522482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511a22b-31aa-43e5-8b4e-fbf3d3232f44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.524538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511a22b-31aa-43e5-8b4e-fbf3d3232f44 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.541466 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7a583-6e54-4a13-ba24-71354b06ffcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.543250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7a583-6e54-4a13-ba24-71354b06ffcc service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.550444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 808/1620] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:01 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:01.551256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511a22b-31aa-43e5-8b4e-fbf3d3232f44 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.562774 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 813/1621] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:01.563994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7a583-6e54-4a13-ba24-71354b06ffcc service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.565733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511a22b-31aa-43e5-8b4e-fbf3d3232f44 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.571299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0a80a-5d42-4aa4-8441-259091cf8bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.572063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0a80a-5d42-4aa4-8441-259091cf8bf6 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.572212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0a80a-5d42-4aa4-8441-259091cf8bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.572489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0a80a-5d42-4aa4-8441-259091cf8bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.574117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7a583-6e54-4a13-ba24-71354b06ffcc service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.580910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f4867-35b4-47c1-96d7-36e65d8cbfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.581897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f4867-35b4-47c1-96d7-36e65d8cbfeb admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.581897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f4867-35b4-47c1-96d7-36e65d8cbfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.582420 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f4867-35b4-47c1-96d7-36e65d8cbfeb admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.583020 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f4867-35b4-47c1-96d7-36e65d8cbfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.584938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f4867-35b4-47c1-96d7-36e65d8cbfeb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.616289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 814/1622] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:01 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:01.616289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f4867-35b4-47c1-96d7-36e65d8cbfeb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.633534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f4867-35b4-47c1-96d7-36e65d8cbfeb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.639700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71108785-2110-4cc4-b5c2-483b36a405aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.640567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71108785-2110-4cc4-b5c2-483b36a405aa service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.640957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71108785-2110-4cc4-b5c2-483b36a405aa service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.641328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71108785-2110-4cc4-b5c2-483b36a405aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.649353 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0a80a-5d42-4aa4-8441-259091cf8bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.651497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0a80a-5d42-4aa4-8441-259091cf8bf6 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.695806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 809/1623] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:01.696857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0a80a-5d42-4aa4-8441-259091cf8bf6 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.707643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:01.720562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0a80a-5d42-4aa4-8441-259091cf8bf6 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.722857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71108785-2110-4cc4-b5c2-483b36a405aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.727226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71108785-2110-4cc4-b5c2-483b36a405aa service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.727566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbf8eb-f94e-4957-ba18-41c134c9dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.728200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbf8eb-f94e-4957-ba18-41c134c9dc28 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.728779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbf8eb-f94e-4957-ba18-41c134c9dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.729060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbf8eb-f94e-4957-ba18-41c134c9dc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.729726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbf8eb-f94e-4957-ba18-41c134c9dc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.731337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbf8eb-f94e-4957-ba18-41c134c9dc28 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.744279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 815/1624] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:01.760173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71108785-2110-4cc4-b5c2-483b36a405aa service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.780832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 810/1625] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:01.784314 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbf8eb-f94e-4957-ba18-41c134c9dc28 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.798855 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71108785-2110-4cc4-b5c2-483b36a405aa service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.807131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334c1fb-d3cb-47c1-aad8-385c5a4a8392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.808329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334c1fb-d3cb-47c1-aad8-385c5a4a8392 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.808835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334c1fb-d3cb-47c1-aad8-385c5a4a8392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.809320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334c1fb-d3cb-47c1-aad8-385c5a4a8392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.809927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbf8eb-f94e-4957-ba18-41c134c9dc28 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.810978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334c1fb-d3cb-47c1-aad8-385c5a4a8392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.819821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334c1fb-d3cb-47c1-aad8-385c5a4a8392 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.833907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df13c-75f2-4de1-8899-8be9ee9a0912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.834603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df13c-75f2-4de1-8899-8be9ee9a0912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.835160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df13c-75f2-4de1-8899-8be9ee9a0912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.835160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df13c-75f2-4de1-8899-8be9ee9a0912 admin admin] PATH_INFO: `/v3/projects/ecc3312a2a5b4d1794ed215e21f73eb1/users/3911ed19b604486f980cba58187a3cd9/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.842405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 816/1626] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:01.847307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334c1fb-d3cb-47c1-aad8-385c5a4a8392 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.871426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334c1fb-d3cb-47c1-aad8-385c5a4a8392 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:01.882243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a4d6f-6b0d-4a90-ac7f-e6284b35db22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:01.884562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a4d6f-6b0d-4a90-ac7f-e6284b35db22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:01.885165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a4d6f-6b0d-4a90-ac7f-e6284b35db22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:01.885799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a4d6f-6b0d-4a90-ac7f-e6284b35db22 admin admin] PATH_INFO: `/v3/projects/4603db70ebd24abe949d8e11d932b181/users/36a0935f206c4003afa81631573a331b/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:01.887719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49df13c-75f2-4de1-8899-8be9ee9a0912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc3312a2a5b4d1794ed215e21f73eb1, user_id=3911ed19b604486f980cba58187a3cd9, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.891171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49df13c-75f2-4de1-8899-8be9ee9a0912 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.924487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a4d6f-6b0d-4a90-ac7f-e6284b35db22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4603db70ebd24abe949d8e11d932b181, user_id=36a0935f206c4003afa81631573a331b, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:01.928138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 811/1627] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:01 2022] PUT /identity/v3/projects/ecc3312a2a5b4d1794ed215e21f73eb1/users/3911ed19b604486f980cba58187a3cd9/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:01.932063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a4d6f-6b0d-4a90-ac7f-e6284b35db22 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:01.932789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df13c-75f2-4de1-8899-8be9ee9a0912 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:01.948723 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 817/1628] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:01 2022] PUT /identity/v3/projects/4603db70ebd24abe949d8e11d932b181/users/36a0935f206c4003afa81631573a331b/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:01.954629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a4d6f-6b0d-4a90-ac7f-e6284b35db22 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:02.033018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a4d6f-6b0d-4a90-ac7f-e6284b35db22 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:02.038632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1dda5-bb65-4fe5-a0f2-e41aafffafa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:02.039413 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1dda5-bb65-4fe5-a0f2-e41aafffafa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.039797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1dda5-bb65-4fe5-a0f2-e41aafffafa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.040274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1dda5-bb65-4fe5-a0f2-e41aafffafa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.041216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1dda5-bb65-4fe5-a0f2-e41aafffafa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:02.044210 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1dda5-bb65-4fe5-a0f2-e41aafffafa4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:02.059404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 818/1629] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:02.063622 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1dda5-bb65-4fe5-a0f2-e41aafffafa4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:02.066457 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df13c-75f2-4de1-8899-8be9ee9a0912 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:02.078428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1dda5-bb65-4fe5-a0f2-e41aafffafa4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:02.082105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae518f-e88a-4a6f-91fc-db6c96b021f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:02.082742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae518f-e88a-4a6f-91fc-db6c96b021f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.083083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae518f-e88a-4a6f-91fc-db6c96b021f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.083368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae518f-e88a-4a6f-91fc-db6c96b021f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.084031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae518f-e88a-4a6f-91fc-db6c96b021f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:02.084358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925950b4-87ca-4d25-9c6b-63afcdd0a80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:02.085198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925950b4-87ca-4d25-9c6b-63afcdd0a80d admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.085694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae518f-e88a-4a6f-91fc-db6c96b021f3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:02.087320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925950b4-87ca-4d25-9c6b-63afcdd0a80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.087613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925950b4-87ca-4d25-9c6b-63afcdd0a80d admin admin] PATH_INFO: `/v3/projects/4603db70ebd24abe949d8e11d932b181/users/36a0935f206c4003afa81631573a331b/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.089816 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925950b4-87ca-4d25-9c6b-63afcdd0a80d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4603db70ebd24abe949d8e11d932b181, user_id=36a0935f206c4003afa81631573a331b, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:02.092801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925950b4-87ca-4d25-9c6b-63afcdd0a80d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:02.106936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 812/1630] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:04:02.111114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae518f-e88a-4a6f-91fc-db6c96b021f3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:02.112536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 819/1631] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:02 2022] PUT /identity/v3/projects/4603db70ebd24abe949d8e11d932b181/users/36a0935f206c4003afa81631573a331b/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:02.123112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40266b-3976-4027-8b84-7103a849a2b3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.123328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40266b-3976-4027-8b84-7103a849a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.123570 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40266b-3976-4027-8b84-7103a849a2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.135929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae518f-e88a-4a6f-91fc-db6c96b021f3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:02.179584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9c40266b-3976-4027-8b84-7103a849a2b3 None None] MFA Rules not processed for user `36a0935f206c4003afa81631573a331b`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:02.182016 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9c40266b-3976-4027-8b84-7103a849a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:02.198218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:02.273361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b32d7-3bcc-47de-993d-c4f432e68765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:02.274186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b32d7-3bcc-47de-993d-c4f432e68765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.274535 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b32d7-3bcc-47de-993d-c4f432e68765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.274912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b32d7-3bcc-47de-993d-c4f432e68765 admin admin] PATH_INFO: `/v3/projects/ecc3312a2a5b4d1794ed215e21f73eb1/users/3911ed19b604486f980cba58187a3cd9/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.276976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b32d7-3bcc-47de-993d-c4f432e68765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc3312a2a5b4d1794ed215e21f73eb1, user_id=3911ed19b604486f980cba58187a3cd9, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:02.279791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b32d7-3bcc-47de-993d-c4f432e68765 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:02.301161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 813/1632] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:02 2022] PUT /identity/v3/projects/ecc3312a2a5b4d1794ed215e21f73eb1/users/3911ed19b604486f980cba58187a3cd9/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:02.301161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebab77-0094-47c2-a184-a94abd7c0c3f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.301161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebab77-0094-47c2-a184-a94abd7c0c3f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.301161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebab77-0094-47c2-a184-a94abd7c0c3f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.301161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 814/1633] 10.222.0.81 () {54 vars in 912 bytes} [Thu Aug 18 17:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:04:02.301161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb1bc-eb2e-4b7c-81bf-c9aa64f1c51e None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.301758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb1bc-eb2e-4b7c-81bf-c9aa64f1c51e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.301758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb1bc-eb2e-4b7c-81bf-c9aa64f1c51e None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.301758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 815/1634] 10.222.0.81 () {54 vars in 912 bytes} [Thu Aug 18 17:04:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:04:02.308010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c25ac-b386-45f5-97c3-1551f3f90fb0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.308666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c25ac-b386-45f5-97c3-1551f3f90fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.308884 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c25ac-b386-45f5-97c3-1551f3f90fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.319496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 820/1635] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:02.323670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d790f2-fa87-462f-8d89-016108840410 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.329018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d790f2-fa87-462f-8d89-016108840410 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.332638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d790f2-fa87-462f-8d89-016108840410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.363123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-265c25ac-b386-45f5-97c3-1551f3f90fb0 None None] MFA Rules not processed for user `3911ed19b604486f980cba58187a3cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:02.364654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-265c25ac-b386-45f5-97c3-1551f3f90fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:02.369137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-72d790f2-fa87-462f-8d89-016108840410 None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:02.371899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-72d790f2-fa87-462f-8d89-016108840410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:02.443137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:02.488673 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 816/1636] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:02.490593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4a137-2868-4a0e-96f7-75ff64b4a686 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.490898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4a137-2868-4a0e-96f7-75ff64b4a686 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.491233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4a137-2868-4a0e-96f7-75ff64b4a686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.522248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-edb4a137-2868-4a0e-96f7-75ff64b4a686 None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:02.532941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-edb4a137-2868-4a0e-96f7-75ff64b4a686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:02.580147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 821/1637] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:02.581314 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d790f2-fa87-462f-8d89-016108840410 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:02.635089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 817/1638] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:02.636053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4a137-2868-4a0e-96f7-75ff64b4a686 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:02.702631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d790f2-fa87-462f-8d89-016108840410 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:02.713086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c6841-ef05-4668-a9a7-6d813b319da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:02.715217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c6841-ef05-4668-a9a7-6d813b319da9 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.715671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c6841-ef05-4668-a9a7-6d813b319da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.716116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c6841-ef05-4668-a9a7-6d813b319da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.745387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:02.774362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4a137-2868-4a0e-96f7-75ff64b4a686 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:02.779267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d7165-c7a7-4169-be59-081086eed6f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:02.782551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d7165-c7a7-4169-be59-081086eed6f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.782551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d7165-c7a7-4169-be59-081086eed6f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.782551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d7165-c7a7-4169-be59-081086eed6f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.795213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d7165-c7a7-4169-be59-081086eed6f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:02.797014 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d7165-c7a7-4169-be59-081086eed6f6 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:02.811138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 818/1639] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:02.842198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c6841-ef05-4668-a9a7-6d813b319da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:02.844430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c6841-ef05-4668-a9a7-6d813b319da9 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:02.857827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 822/1640] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:02.934472 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d7165-c7a7-4169-be59-081086eed6f6 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:02.938123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c6841-ef05-4668-a9a7-6d813b319da9 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:02.943707 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d7165-c7a7-4169-be59-081086eed6f6 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:02.954638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c6841-ef05-4668-a9a7-6d813b319da9 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:02.958271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609243ab-89b2-4285-85cc-c016120e0279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:02.959147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609243ab-89b2-4285-85cc-c016120e0279 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.959711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609243ab-89b2-4285-85cc-c016120e0279 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.960255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609243ab-89b2-4285-85cc-c016120e0279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.961276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521dfa7-b143-4794-8f67-30d29b32c56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:02.962001 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521dfa7-b143-4794-8f67-30d29b32c56b service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:02.962358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521dfa7-b143-4794-8f67-30d29b32c56b service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:02.962875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521dfa7-b143-4794-8f67-30d29b32c56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:02.987267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521dfa7-b143-4794-8f67-30d29b32c56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:02.989491 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521dfa7-b143-4794-8f67-30d29b32c56b service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:02.994536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609243ab-89b2-4285-85cc-c016120e0279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:02.997609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609243ab-89b2-4285-85cc-c016120e0279 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:03.008212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 823/1641] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:03.055569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 819/1642] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:04.143001 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521dfa7-b143-4794-8f67-30d29b32c56b service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:04.154474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609243ab-89b2-4285-85cc-c016120e0279 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:04.163875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521dfa7-b143-4794-8f67-30d29b32c56b service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:04.172490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609243ab-89b2-4285-85cc-c016120e0279 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:04.174427 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228973d1-fb21-40cf-baab-33b04ec47bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:04.175152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228973d1-fb21-40cf-baab-33b04ec47bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:04.175530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228973d1-fb21-40cf-baab-33b04ec47bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:04.175902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228973d1-fb21-40cf-baab-33b04ec47bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:04.188891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c7b0e-3615-44fe-a2cb-571320231301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:04.190149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7b0e-3615-44fe-a2cb-571320231301 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:04.192620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7b0e-3615-44fe-a2cb-571320231301 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:04.193028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c7b0e-3615-44fe-a2cb-571320231301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:04.323145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c7b0e-3615-44fe-a2cb-571320231301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:04.328587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:04.329229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c7b0e-3615-44fe-a2cb-571320231301 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:04.347553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 820/1643] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:04.348477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228973d1-fb21-40cf-baab-33b04ec47bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:04.348863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c7b0e-3615-44fe-a2cb-571320231301 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:04.350311 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228973d1-fb21-40cf-baab-33b04ec47bc6 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:04.361588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c7b0e-3615-44fe-a2cb-571320231301 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:04.363167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 824/1644] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:04.387836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee476f-3c9d-4a35-a2b4-12229ae7ab09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:04.389860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee476f-3c9d-4a35-a2b4-12229ae7ab09 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:04.391490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee476f-3c9d-4a35-a2b4-12229ae7ab09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:04.392008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee476f-3c9d-4a35-a2b4-12229ae7ab09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:04.575746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee476f-3c9d-4a35-a2b4-12229ae7ab09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:04.587876 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee476f-3c9d-4a35-a2b4-12229ae7ab09 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:04.607450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 821/1645] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:05.165698 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228973d1-fb21-40cf-baab-33b04ec47bc6 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:05.345134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228973d1-fb21-40cf-baab-33b04ec47bc6 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:05.361015 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:05.363457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:05.364743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:05.365210 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] PATH_INFO: `/v3/users/bf1495a3fc4c44e2a323d930c6a39447` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:05.369320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1495a3fc4c44e2a323d930c6a39447)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:05.371055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: WARNING py.warnings [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:04:05.371055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: warnings.warn(msg) Aug 18 17:04:05.371055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: Aug 18 17:04:05.377341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:05.541454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1495a3fc4c44e2a323d930c6a39447'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:05.543128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1495a3fc4c44e2a323d930c6a39447'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:05.592707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1495a3fc4c44e2a323d930c6a39447'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:05.618764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1495a3fc4c44e2a323d930c6a39447'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:05.620715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1495a3fc4c44e2a323d930c6a39447'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:05.653564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 825/1646] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:05 2022] DELETE /identity/v3/users/bf1495a3fc4c44e2a323d930c6a39447 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:05.658093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81c0b-a098-4afe-aaec-f03cec9f7990 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:05.658882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81c0b-a098-4afe-aaec-f03cec9f7990 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:05.658882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81c0b-a098-4afe-aaec-f03cec9f7990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:05.693730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cdb81c0b-a098-4afe-aaec-f03cec9f7990 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:05.695958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cdb81c0b-a098-4afe-aaec-f03cec9f7990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:06.135634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 822/1647] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:06.180985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:06.183458 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:06.420327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ab161-81a2-4293-afec-75d8a69f220a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:06.430760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ac08-3eb6-4f84-afd8-3b8e89c166cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:06.431456 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ac08-3eb6-4f84-afd8-3b8e89c166cd service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:06.431746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ac08-3eb6-4f84-afd8-3b8e89c166cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:06.432027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ac08-3eb6-4f84-afd8-3b8e89c166cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:06.461069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710ac08-3eb6-4f84-afd8-3b8e89c166cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:06.462588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710ac08-3eb6-4f84-afd8-3b8e89c166cd service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:06.487732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 826/1648] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:08.198996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb81c0b-a098-4afe-aaec-f03cec9f7990 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:08.201997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cdb81c0b-a098-4afe-aaec-f03cec9f7990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:08.224648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:08.235965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb81c0b-a098-4afe-aaec-f03cec9f7990 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:08.249572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:08.250825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:08.251179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:08.251526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] PATH_INFO: `/v3/projects/18ddcf0d99694f4daa53d9232e2c25fe` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:08.255498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ddcf0d99694f4daa53d9232e2c25fe)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:08.256665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: WARNING py.warnings [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:04:08.256665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: warnings.warn(msg) Aug 18 17:04:08.256665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: Aug 18 17:04:08.261031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:08.351581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ac08-3eb6-4f84-afd8-3b8e89c166cd service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:08.355201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6710ac08-3eb6-4f84-afd8-3b8e89c166cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:08.377502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ac08-3eb6-4f84-afd8-3b8e89c166cd service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:08.401085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ddcf0d99694f4daa53d9232e2c25fe', 'request_id': 'req-6ff7e222-94f1-48d8-99b4-59a96ed13e12'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:08.408407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:08.456932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ddcf0d99694f4daa53d9232e2c25fe', 'request_id': 'req-6ff7e222-94f1-48d8-99b4-59a96ed13e12'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:08.474073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ddcf0d99694f4daa53d9232e2c25fe', 'request_id': 'req-6ff7e222-94f1-48d8-99b4-59a96ed13e12'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:08.500338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] The token cache is being invalidate because project 18ddcf0d99694f4daa53d9232e2c25fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:08.500770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:08.501751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6ff7e222-94f1-48d8-99b4-59a96ed13e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:08.510383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 823/1649] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:08 2022] DELETE /identity/v3/projects/18ddcf0d99694f4daa53d9232e2c25fe => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:08.511832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb1c2-9021-4cfe-8a9c-68e986838dec None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:08.512125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb1c2-9021-4cfe-8a9c-68e986838dec None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:08.512402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb1c2-9021-4cfe-8a9c-68e986838dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:08.527134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:08.528060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:08.528538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:08.530136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] PATH_INFO: `/v3/users/ea56e67708a4462085ef23115b7676a4` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:08.532423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea56e67708a4462085ef23115b7676a4)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:08.535257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:08.590109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1aceb1c2-9021-4cfe-8a9c-68e986838dec None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:08.591659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1aceb1c2-9021-4cfe-8a9c-68e986838dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:08.609355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 824/1650] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:08.610921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9e265-7920-4351-ab71-987839cf71de None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:08.611311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9e265-7920-4351-ab71-987839cf71de None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:08.611690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9e265-7920-4351-ab71-987839cf71de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:08.628504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea56e67708a4462085ef23115b7676a4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:08.629244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea56e67708a4462085ef23115b7676a4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:08.636192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bdb9e265-7920-4351-ab71-987839cf71de None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:08.637855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bdb9e265-7920-4351-ab71-987839cf71de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:08.652262 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 825/1651] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:08.653644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9e265-7920-4351-ab71-987839cf71de None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:08.666675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9e265-7920-4351-ab71-987839cf71de None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:08.669295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea56e67708a4462085ef23115b7676a4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:08.682684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6f705-93b9-4a0d-ba47-a1dcbe369a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:08.683616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6f705-93b9-4a0d-ba47-a1dcbe369a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:08.684083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6f705-93b9-4a0d-ba47-a1dcbe369a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:08.684801 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6f705-93b9-4a0d-ba47-a1dcbe369a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:08.685610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea56e67708a4462085ef23115b7676a4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:08.686502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6f705-93b9-4a0d-ba47-a1dcbe369a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:08.687980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6f705-93b9-4a0d-ba47-a1dcbe369a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:08.700034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1c290616-0a42-4d11-968a-dd7641d732e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea56e67708a4462085ef23115b7676a4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:08.705185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6f705-93b9-4a0d-ba47-a1dcbe369a80 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:08.750995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 827/1652] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:08 2022] DELETE /identity/v3/users/ea56e67708a4462085ef23115b7676a4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:08.753273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 826/1653] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:08.758712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dbf62-882b-45b6-9f85-8ad79a33e7fb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:08.759905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dbf62-882b-45b6-9f85-8ad79a33e7fb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:08.760334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dbf62-882b-45b6-9f85-8ad79a33e7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:08.764556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6f705-93b9-4a0d-ba47-a1dcbe369a80 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:08.797700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6f705-93b9-4a0d-ba47-a1dcbe369a80 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:08.809321 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-385dbf62-882b-45b6-9f85-8ad79a33e7fb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:08.813413 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-385dbf62-882b-45b6-9f85-8ad79a33e7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:08.985632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10929228-e12c-4dec-ba86-c5a3f4f391e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:08.986481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10929228-e12c-4dec-ba86-c5a3f4f391e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:08.986767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10929228-e12c-4dec-ba86-c5a3f4f391e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:08.987041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10929228-e12c-4dec-ba86-c5a3f4f391e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:08.988827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10929228-e12c-4dec-ba86-c5a3f4f391e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:09.011118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10929228-e12c-4dec-ba86-c5a3f4f391e3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:09.020646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 828/1654] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:09.078753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dbf62-882b-45b6-9f85-8ad79a33e7fb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:09.080551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-385dbf62-882b-45b6-9f85-8ad79a33e7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:09.109278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 827/1655] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:08 2022] POST /identity/v3/projects => generated 367 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:09.111344 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10929228-e12c-4dec-ba86-c5a3f4f391e3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:09.194856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:09.300668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dbf62-882b-45b6-9f85-8ad79a33e7fb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:09.316257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:09.370800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10929228-e12c-4dec-ba86-c5a3f4f391e3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:09.387335 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a51a52-d6d6-4dbc-b74b-a8f6016ec356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:09.388241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a51a52-d6d6-4dbc-b74b-a8f6016ec356 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:09.388776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a51a52-d6d6-4dbc-b74b-a8f6016ec356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:09.389219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a51a52-d6d6-4dbc-b74b-a8f6016ec356 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:09.395523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a51a52-d6d6-4dbc-b74b-a8f6016ec356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:09.398484 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a51a52-d6d6-4dbc-b74b-a8f6016ec356 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:09.464305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 828/1656] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:09 2022] POST /identity/v3/users => generated 284 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:09.472954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a51a52-d6d6-4dbc-b74b-a8f6016ec356 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:09.492358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bc789-2328-4035-aeb3-7e55d25ce1e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:09.495407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bc789-2328-4035-aeb3-7e55d25ce1e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:09.495689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bc789-2328-4035-aeb3-7e55d25ce1e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:09.495964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bc789-2328-4035-aeb3-7e55d25ce1e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:09.510021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a51a52-d6d6-4dbc-b74b-a8f6016ec356 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:09.528016 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bc789-2328-4035-aeb3-7e55d25ce1e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:09.529763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bc789-2328-4035-aeb3-7e55d25ce1e4 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:09.556132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 829/1657] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:09.557107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ad36-43aa-4725-9fea-869968af1a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:09.558407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ad36-43aa-4725-9fea-869968af1a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:09.558698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ad36-43aa-4725-9fea-869968af1a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:09.561094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ad36-43aa-4725-9fea-869968af1a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:09.562932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9ad36-43aa-4725-9fea-869968af1a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:09.591177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9ad36-43aa-4725-9fea-869968af1a9a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:09.638986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 829/1658] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:09.643832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bc789-2328-4035-aeb3-7e55d25ce1e4 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:09.656882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bc789-2328-4035-aeb3-7e55d25ce1e4 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:09.663288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f96c41-f097-44d3-82c4-af26099a0410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:09.664169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f96c41-f097-44d3-82c4-af26099a0410 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:09.664689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f96c41-f097-44d3-82c4-af26099a0410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:09.665123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f96c41-f097-44d3-82c4-af26099a0410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:09.665923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f96c41-f097-44d3-82c4-af26099a0410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:09.667708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f96c41-f097-44d3-82c4-af26099a0410 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:09.691695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 830/1659] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:09.692441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ad36-43aa-4725-9fea-869968af1a9a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:09.706061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ad36-43aa-4725-9fea-869968af1a9a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:09.733728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf708e7-7629-4b2e-a298-ddc894101635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:09.735908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf708e7-7629-4b2e-a298-ddc894101635 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:09.736211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf708e7-7629-4b2e-a298-ddc894101635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:09.736508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf708e7-7629-4b2e-a298-ddc894101635 admin admin] PATH_INFO: `/v3/projects/c8f3e69008e24b4f8a8223ed8e39935d/users/f365b78d51cb4102b172886089199d67/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:09.813503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf708e7-7629-4b2e-a298-ddc894101635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f3e69008e24b4f8a8223ed8e39935d, user_id=f365b78d51cb4102b172886089199d67, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:09.828768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf708e7-7629-4b2e-a298-ddc894101635 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:09.869940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 830/1660] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:09 2022] PUT /identity/v3/projects/c8f3e69008e24b4f8a8223ed8e39935d/users/f365b78d51cb4102b172886089199d67/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:09.879906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5018133-ba78-4b88-9a87-46a05138283e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:09.880195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5018133-ba78-4b88-9a87-46a05138283e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:09.880488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5018133-ba78-4b88-9a87-46a05138283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:09.956915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d5018133-ba78-4b88-9a87-46a05138283e None None] MFA Rules not processed for user `f365b78d51cb4102b172886089199d67`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:09.958308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d5018133-ba78-4b88-9a87-46a05138283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:10.190363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 831/1661] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:10.195031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf708e7-7629-4b2e-a298-ddc894101635 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:10.386903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf708e7-7629-4b2e-a298-ddc894101635 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:10.395265 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c48113-8305-44ae-b0a1-1ef692f5f860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:10.396653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c48113-8305-44ae-b0a1-1ef692f5f860 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:10.397193 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c48113-8305-44ae-b0a1-1ef692f5f860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:10.397647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c48113-8305-44ae-b0a1-1ef692f5f860 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:10.398514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c48113-8305-44ae-b0a1-1ef692f5f860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:10.401625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c48113-8305-44ae-b0a1-1ef692f5f860 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:10.463456 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 831/1662] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:10 2022] POST /identity/v3/projects => generated 369 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:10.468189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5018133-ba78-4b88-9a87-46a05138283e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:10.489153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5018133-ba78-4b88-9a87-46a05138283e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:10.741524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419423f-a297-4c74-a4b1-acf081acb8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:10.742169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419423f-a297-4c74-a4b1-acf081acb8dd admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:10.742719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419423f-a297-4c74-a4b1-acf081acb8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:10.742719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419423f-a297-4c74-a4b1-acf081acb8dd admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:10.743350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419423f-a297-4c74-a4b1-acf081acb8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:10.745338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419423f-a297-4c74-a4b1-acf081acb8dd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:10.809114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:10.824306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 832/1663] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:10 2022] POST /identity/v3/users => generated 291 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:10.829069 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c48113-8305-44ae-b0a1-1ef692f5f860 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:10.855628 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c48113-8305-44ae-b0a1-1ef692f5f860 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:10.864687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d62b-0dd5-42b4-a7c0-171bc7a36220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:10.868444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d62b-0dd5-42b4-a7c0-171bc7a36220 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:10.870258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d62b-0dd5-42b4-a7c0-171bc7a36220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:10.870258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6d62b-0dd5-42b4-a7c0-171bc7a36220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:10.870258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6d62b-0dd5-42b4-a7c0-171bc7a36220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:10.871714 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6d62b-0dd5-42b4-a7c0-171bc7a36220 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:10.922221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 832/1664] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:10.927906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419423f-a297-4c74-a4b1-acf081acb8dd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:10.945555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419423f-a297-4c74-a4b1-acf081acb8dd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:10.961634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b737e4-bf89-4ffc-97e7-91dd0a58c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:10.962476 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b737e4-bf89-4ffc-97e7-91dd0a58c0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:10.962938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b737e4-bf89-4ffc-97e7-91dd0a58c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:10.963212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b737e4-bf89-4ffc-97e7-91dd0a58c0cd admin admin] PATH_INFO: `/v3/projects/068b06f8dd22408781067513ff3f210d/users/f64386f08f574c2a8539f604a7fa6d26/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:11.013048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b737e4-bf89-4ffc-97e7-91dd0a58c0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=068b06f8dd22408781067513ff3f210d, user_id=f64386f08f574c2a8539f604a7fa6d26, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:11.020287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b737e4-bf89-4ffc-97e7-91dd0a58c0cd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:11.046116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 833/1665] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:10 2022] PUT /identity/v3/projects/068b06f8dd22408781067513ff3f210d/users/f64386f08f574c2a8539f604a7fa6d26/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:11.052553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d62b-0dd5-42b4-a7c0-171bc7a36220 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:11.070864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6d62b-0dd5-42b4-a7c0-171bc7a36220 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:11.211246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ad9e5-181f-459a-bf2b-6b252cdbd1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:11.211949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ad9e5-181f-459a-bf2b-6b252cdbd1cb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:11.212174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ad9e5-181f-459a-bf2b-6b252cdbd1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:11.212451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ad9e5-181f-459a-bf2b-6b252cdbd1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:11.213139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ad9e5-181f-459a-bf2b-6b252cdbd1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:11.214978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ad9e5-181f-459a-bf2b-6b252cdbd1cb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:11.237772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 833/1666] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:11.242069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b737e4-bf89-4ffc-97e7-91dd0a58c0cd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:11.256896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b737e4-bf89-4ffc-97e7-91dd0a58c0cd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:11.280557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e57b6-2c88-453c-8920-cb06202fc52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:11.282415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e57b6-2c88-453c-8920-cb06202fc52f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:11.282415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e57b6-2c88-453c-8920-cb06202fc52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:11.283115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e57b6-2c88-453c-8920-cb06202fc52f admin admin] PATH_INFO: `/v3/projects/068b06f8dd22408781067513ff3f210d/users/f64386f08f574c2a8539f604a7fa6d26/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:11.287837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e57b6-2c88-453c-8920-cb06202fc52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=068b06f8dd22408781067513ff3f210d, user_id=f64386f08f574c2a8539f604a7fa6d26, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:11.292060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e57b6-2c88-453c-8920-cb06202fc52f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:11.324279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 834/1667] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:11 2022] PUT /identity/v3/projects/068b06f8dd22408781067513ff3f210d/users/f64386f08f574c2a8539f604a7fa6d26/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:11.336402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5759d-b4fd-45e0-9786-46655725f47a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:11.337027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5759d-b4fd-45e0-9786-46655725f47a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:11.337493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5759d-b4fd-45e0-9786-46655725f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:11.383688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:11.393777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e3a5759d-b4fd-45e0-9786-46655725f47a None None] MFA Rules not processed for user `f64386f08f574c2a8539f604a7fa6d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:11.396094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e3a5759d-b4fd-45e0-9786-46655725f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:11.492828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 834/1668] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:11.504040 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e57b6-2c88-453c-8920-cb06202fc52f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:11.506750 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c14e57b6-2c88-453c-8920-cb06202fc52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:11.693819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e57b6-2c88-453c-8920-cb06202fc52f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:11.707667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5759d-b4fd-45e0-9786-46655725f47a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:11.709203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e3a5759d-b4fd-45e0-9786-46655725f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:11.717554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e0554-da76-4ccf-bcd3-3a1418747184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:11.719537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e0554-da76-4ccf-bcd3-3a1418747184 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:11.719943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e0554-da76-4ccf-bcd3-3a1418747184 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:11.724418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e0554-da76-4ccf-bcd3-3a1418747184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:11.732949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e0554-da76-4ccf-bcd3-3a1418747184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:11.738665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e0554-da76-4ccf-bcd3-3a1418747184 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:11.748447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 835/1669] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:11.919276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5759d-b4fd-45e0-9786-46655725f47a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:11.932102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:11.933191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:11.934696 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:11.934984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] PATH_INFO: `/v3/users/706d3e83eec04ab7ae4f6abfcdce2cf8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:11.940151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] RBAC: Authorizing `identity:delete_user(user_id=706d3e83eec04ab7ae4f6abfcdce2cf8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:11.945442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:12.066259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '706d3e83eec04ab7ae4f6abfcdce2cf8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:12.091925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '706d3e83eec04ab7ae4f6abfcdce2cf8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:12.091925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '706d3e83eec04ab7ae4f6abfcdce2cf8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:12.092667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '706d3e83eec04ab7ae4f6abfcdce2cf8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:12.104173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '706d3e83eec04ab7ae4f6abfcdce2cf8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:12.154802 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 835/1670] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:11 2022] DELETE /identity/v3/users/706d3e83eec04ab7ae4f6abfcdce2cf8 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:12.159074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d469-d3e5-489d-bd26-d148f32e8bac None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:12.159365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d469-d3e5-489d-bd26-d148f32e8bac None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:12.159641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d469-d3e5-489d-bd26-d148f32e8bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:12.189434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7b17d469-d3e5-489d-bd26-d148f32e8bac None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:12.190864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7b17d469-d3e5-489d-bd26-d148f32e8bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:12.312517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 836/1671] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:12.346971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:12.348950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:12.396044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:12.502347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a7d8d-c0b6-406c-b28d-8abc427d336b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:12.517370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4079769-0c92-48eb-a488-82f91d456aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:12.518117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4079769-0c92-48eb-a488-82f91d456aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:12.518499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4079769-0c92-48eb-a488-82f91d456aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:12.518906 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4079769-0c92-48eb-a488-82f91d456aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:12.540840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4079769-0c92-48eb-a488-82f91d456aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:12.542550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4079769-0c92-48eb-a488-82f91d456aa6 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:12.564737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 836/1672] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:13.472109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d469-d3e5-489d-bd26-d148f32e8bac None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:13.473472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7b17d469-d3e5-489d-bd26-d148f32e8bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:13.503557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d469-d3e5-489d-bd26-d148f32e8bac None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:13.518870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:13.519869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:13.520304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:13.520764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] PATH_INFO: `/v3/projects/51c0ac563c7e4963a2b6fc82147c2cf4` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:13.522156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c0ac563c7e4963a2b6fc82147c2cf4)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:13.525123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:13.670169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c0ac563c7e4963a2b6fc82147c2cf4', 'request_id': 'req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:13.694639 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c0ac563c7e4963a2b6fc82147c2cf4', 'request_id': 'req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:13.714369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c0ac563c7e4963a2b6fc82147c2cf4', 'request_id': 'req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:13.716698 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:13.741823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] The token cache is being invalidate because project 51c0ac563c7e4963a2b6fc82147c2cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:13.742431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:13.745196 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c76e39e9-b536-4fa6-b3b3-3cb125cd6f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:13.748633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 837/1673] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:13 2022] DELETE /identity/v3/projects/51c0ac563c7e4963a2b6fc82147c2cf4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:13.753708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f3d44-cd5c-4302-b3e0-d45de7fea389 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:13.754694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f3d44-cd5c-4302-b3e0-d45de7fea389 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:13.755871 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f3d44-cd5c-4302-b3e0-d45de7fea389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:13.775557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7b280-a5ad-4945-a2c0-33edb0f8c95e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:13.776132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7b280-a5ad-4945-a2c0-33edb0f8c95e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:13.776960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7b280-a5ad-4945-a2c0-33edb0f8c95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:13.819795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8ee7b280-a5ad-4945-a2c0-33edb0f8c95e None None] MFA Rules not processed for user `28addacbb72f4971acf2b61f904af131`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:13.821235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8ee7b280-a5ad-4945-a2c0-33edb0f8c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:13.828679 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5f7f3d44-cd5c-4302-b3e0-d45de7fea389 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:13.840913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5f7f3d44-cd5c-4302-b3e0-d45de7fea389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:14.002423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 838/1674] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:14.005804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d339e1d-f310-41f1-9280-12bb6485cd64 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:14.007016 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d339e1d-f310-41f1-9280-12bb6485cd64 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:14.007405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d339e1d-f310-41f1-9280-12bb6485cd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:14.008972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 837/1675] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:14.013637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d968a-38a7-446d-8c10-63fa9498b4ae None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:14.014430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d968a-38a7-446d-8c10-63fa9498b4ae None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:14.016061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d968a-38a7-446d-8c10-63fa9498b4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:14.071000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-634d968a-38a7-446d-8c10-63fa9498b4ae None None] MFA Rules not processed for user `28addacbb72f4971acf2b61f904af131`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:14.074191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-634d968a-38a7-446d-8c10-63fa9498b4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:14.081903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3d339e1d-f310-41f1-9280-12bb6485cd64 None None] MFA Rules not processed for user `368cddc3968c4c39b7ca05c500872b45`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:14.083362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3d339e1d-f310-41f1-9280-12bb6485cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:14.093605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 838/1676] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:14.095285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3e7d8-2d0d-4189-b14c-8735991f9e23 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:14.096282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3e7d8-2d0d-4189-b14c-8735991f9e23 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:14.097509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3e7d8-2d0d-4189-b14c-8735991f9e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:14.147061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2ff3e7d8-2d0d-4189-b14c-8735991f9e23 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:14.152013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2ff3e7d8-2d0d-4189-b14c-8735991f9e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:14.173744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 839/1677] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:14.175212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3e7d8-2d0d-4189-b14c-8735991f9e23 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:14.183837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2ff3e7d8-2d0d-4189-b14c-8735991f9e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:14.311695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 839/1678] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:14.311695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d339e1d-f310-41f1-9280-12bb6485cd64 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:14.341646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d339e1d-f310-41f1-9280-12bb6485cd64 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:14.361398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6fcbc-48db-4a07-ad9e-013f95262189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:14.364336 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6fcbc-48db-4a07-ad9e-013f95262189 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:14.364662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6fcbc-48db-4a07-ad9e-013f95262189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:14.364951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6fcbc-48db-4a07-ad9e-013f95262189 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:14.365644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6fcbc-48db-4a07-ad9e-013f95262189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:14.365962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6fcbc-48db-4a07-ad9e-013f95262189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:14.371276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6fcbc-48db-4a07-ad9e-013f95262189 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:14.420480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 840/1679] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:14.423211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6fcbc-48db-4a07-ad9e-013f95262189 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:14.428480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e5e6fcbc-48db-4a07-ad9e-013f95262189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:14.471191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3e7d8-2d0d-4189-b14c-8735991f9e23 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:14.479055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6fcbc-48db-4a07-ad9e-013f95262189 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:14.496365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:14.497252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:14.498032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:14.498696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] PATH_INFO: `/v3/projects/3dcfef1a11494761b9932b9780fd5e4b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:14.500740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcfef1a11494761b9932b9780fd5e4b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:14.502523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f564a1-ba2d-4e89-9c66-e1764edb044a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:14.503459 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f564a1-ba2d-4e89-9c66-e1764edb044a service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:14.503743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f564a1-ba2d-4e89-9c66-e1764edb044a service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:14.504956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f564a1-ba2d-4e89-9c66-e1764edb044a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:14.507457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:14.531225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f564a1-ba2d-4e89-9c66-e1764edb044a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:14.533082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f564a1-ba2d-4e89-9c66-e1764edb044a service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:14.562856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 840/1680] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:14.563731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f564a1-ba2d-4e89-9c66-e1764edb044a service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:14.576137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-53f564a1-ba2d-4e89-9c66-e1764edb044a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:14.623735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f564a1-ba2d-4e89-9c66-e1764edb044a service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:14.660076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e182737-84c7-42fd-aa39-cad06f7ddf39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:14.660938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182737-84c7-42fd-aa39-cad06f7ddf39 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:14.661324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182737-84c7-42fd-aa39-cad06f7ddf39 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:14.661868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e182737-84c7-42fd-aa39-cad06f7ddf39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:14.684518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e182737-84c7-42fd-aa39-cad06f7ddf39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:14.690804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e182737-84c7-42fd-aa39-cad06f7ddf39 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:14.712055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcfef1a11494761b9932b9780fd5e4b', 'request_id': 'req-26b9c543-7cab-4b35-9476-a2625e2910ea'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:14.735168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:14.751461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 841/1681] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:14.757259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e182737-84c7-42fd-aa39-cad06f7ddf39 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:14.758287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcfef1a11494761b9932b9780fd5e4b', 'request_id': 'req-26b9c543-7cab-4b35-9476-a2625e2910ea'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:14.779941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcfef1a11494761b9932b9780fd5e4b', 'request_id': 'req-26b9c543-7cab-4b35-9476-a2625e2910ea'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:14.794682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e182737-84c7-42fd-aa39-cad06f7ddf39 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:14.821580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] The token cache is being invalidate because project 3dcfef1a11494761b9932b9780fd5e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:14.822165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:14.834396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-26b9c543-7cab-4b35-9476-a2625e2910ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:14.839288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 841/1682] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:14 2022] DELETE /identity/v3/projects/3dcfef1a11494761b9932b9780fd5e4b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:14.844956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062ecec-f4e9-4158-bae3-963c6a116eba None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:14.845252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062ecec-f4e9-4158-bae3-963c6a116eba None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:14.845528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062ecec-f4e9-4158-bae3-963c6a116eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:14.850259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:14.911193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3062ecec-f4e9-4158-bae3-963c6a116eba None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:14.915810 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3062ecec-f4e9-4158-bae3-963c6a116eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:15.076973 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82a569-4a99-41e6-acb9-012a62ef9d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:15.078523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82a569-4a99-41e6-acb9-012a62ef9d16 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:15.081684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82a569-4a99-41e6-acb9-012a62ef9d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:15.082211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82a569-4a99-41e6-acb9-012a62ef9d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:15.084091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82a569-4a99-41e6-acb9-012a62ef9d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:15.087212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82a569-4a99-41e6-acb9-012a62ef9d16 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:15.138778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 842/1683] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:15.139908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062ecec-f4e9-4158-bae3-963c6a116eba None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:15.141853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3062ecec-f4e9-4158-bae3-963c6a116eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:15.176355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062ecec-f4e9-4158-bae3-963c6a116eba None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:15.197991 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:15.198751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:15.199039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:15.199319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] PATH_INFO: `/v3/users/bd9569a742014d079ca605b61255ad14` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:15.201345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 842/1684] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:14 2022] POST /identity/v3/projects => generated 371 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:15.204381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9569a742014d079ca605b61255ad14)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:15.206678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:15.219992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea833-5c9c-46e3-bc88-735a6bc2a6eb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:15.220431 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea833-5c9c-46e3-bc88-735a6bc2a6eb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:15.220878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea833-5c9c-46e3-bc88-735a6bc2a6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:15.309043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a58ea833-5c9c-46e3-bc88-735a6bc2a6eb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:15.314838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a58ea833-5c9c-46e3-bc88-735a6bc2a6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:15.327070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9569a742014d079ca605b61255ad14'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:15.330481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9569a742014d079ca605b61255ad14'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:15.368010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9569a742014d079ca605b61255ad14'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:15.383085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9569a742014d079ca605b61255ad14'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:15.386331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9569a742014d079ca605b61255ad14'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:15.412250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 843/1685] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:15 2022] DELETE /identity/v3/users/bd9569a742014d079ca605b61255ad14 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:15.413212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:15.418106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:15.507171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 843/1686] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:15.508781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89645-7f8a-45ca-b9d4-8fb523b789fc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:15.509076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89645-7f8a-45ca-b9d4-8fb523b789fc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:15.509531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89645-7f8a-45ca-b9d4-8fb523b789fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:15.552307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5dc89645-7f8a-45ca-b9d4-8fb523b789fc None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:15.557733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5dc89645-7f8a-45ca-b9d4-8fb523b789fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:15.590769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:15.627339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b172e2-3448-4bc3-81af-d7ca7c0b456d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:15.646385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377f31d-2e60-43c3-befa-4a165fde2177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:15.647443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377f31d-2e60-43c3-befa-4a165fde2177 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:15.647894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377f31d-2e60-43c3-befa-4a165fde2177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:15.648312 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377f31d-2e60-43c3-befa-4a165fde2177 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:15.649179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377f31d-2e60-43c3-befa-4a165fde2177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:15.651277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377f31d-2e60-43c3-befa-4a165fde2177 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:15.698265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 844/1687] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:15 2022] POST /identity/v3/users => generated 286 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:15.699454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377f31d-2e60-43c3-befa-4a165fde2177 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:15.724268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377f31d-2e60-43c3-befa-4a165fde2177 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:15.730356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92070fc6-478b-4330-b600-08743effc286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:15.731241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92070fc6-478b-4330-b600-08743effc286 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:15.731723 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92070fc6-478b-4330-b600-08743effc286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:15.732206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92070fc6-478b-4330-b600-08743effc286 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:15.733201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92070fc6-478b-4330-b600-08743effc286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:15.733780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92070fc6-478b-4330-b600-08743effc286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:15.735631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92070fc6-478b-4330-b600-08743effc286 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:15.758872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 845/1688] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:15.760627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a5be-8e25-4e60-95cb-9a45e7366ddf None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:15.761142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a5be-8e25-4e60-95cb-9a45e7366ddf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:15.762679 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a5be-8e25-4e60-95cb-9a45e7366ddf None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:15.765592 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 846/1689] 10.222.0.81 () {54 vars in 912 bytes} [Thu Aug 18 17:04:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:04:15.766625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93a5be-8e25-4e60-95cb-9a45e7366ddf None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:15.782391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93a5be-8e25-4e60-95cb-9a45e7366ddf None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:15.794373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc108e-ab2c-4bdc-92e2-64038fd6148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:15.806597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc108e-ab2c-4bdc-92e2-64038fd6148a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:15.807122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc108e-ab2c-4bdc-92e2-64038fd6148a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:15.807713 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc108e-ab2c-4bdc-92e2-64038fd6148a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:15.809057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc108e-ab2c-4bdc-92e2-64038fd6148a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:15.811148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc108e-ab2c-4bdc-92e2-64038fd6148a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:15.813957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 844/1690] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:15.818385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc89645-7f8a-45ca-b9d4-8fb523b789fc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:15.831781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc89645-7f8a-45ca-b9d4-8fb523b789fc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:15.852188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb21a2-dc1c-43a3-9b52-61fc49a77fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:15.852321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb21a2-dc1c-43a3-9b52-61fc49a77fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:15.852665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb21a2-dc1c-43a3-9b52-61fc49a77fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:15.852978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb21a2-dc1c-43a3-9b52-61fc49a77fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:15.853960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb21a2-dc1c-43a3-9b52-61fc49a77fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:15.855963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb21a2-dc1c-43a3-9b52-61fc49a77fa0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:15.859967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 847/1691] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:15.861540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43869d4f-8429-4756-838c-8ba1a238fd37 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:15.861833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43869d4f-8429-4756-838c-8ba1a238fd37 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:15.862117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43869d4f-8429-4756-838c-8ba1a238fd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:15.930440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 845/1692] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:15 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:15.932382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb21a2-dc1c-43a3-9b52-61fc49a77fa0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:15.936605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a7cb21a2-dc1c-43a3-9b52-61fc49a77fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:15.941815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-43869d4f-8429-4756-838c-8ba1a238fd37 None None] MFA Rules not processed for user `7b1fde904acd460899d8c736f5762056`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:15.945186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-43869d4f-8429-4756-838c-8ba1a238fd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:16.035003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:16.151796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 848/1693] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:16.153969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43869d4f-8429-4756-838c-8ba1a238fd37 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:16.168693 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb21a2-dc1c-43a3-9b52-61fc49a77fa0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:16.184088 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549346d-7069-49f7-98c7-67e9b23b0b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:16.184917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549346d-7069-49f7-98c7-67e9b23b0b3b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:16.185204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549346d-7069-49f7-98c7-67e9b23b0b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:16.185479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549346d-7069-49f7-98c7-67e9b23b0b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:16.441729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43869d4f-8429-4756-838c-8ba1a238fd37 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:16.454142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549346d-7069-49f7-98c7-67e9b23b0b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:16.457622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549346d-7069-49f7-98c7-67e9b23b0b3b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:16.460449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871006e6-ec9e-4e49-ac8a-a75d00c8357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:16.461563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871006e6-ec9e-4e49-ac8a-a75d00c8357d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:16.462064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871006e6-ec9e-4e49-ac8a-a75d00c8357d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:16.463077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871006e6-ec9e-4e49-ac8a-a75d00c8357d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:16.463779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871006e6-ec9e-4e49-ac8a-a75d00c8357d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:16.466969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871006e6-ec9e-4e49-ac8a-a75d00c8357d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:16.490626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 846/1694] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:16.492852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549346d-7069-49f7-98c7-67e9b23b0b3b service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:16.508068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 849/1695] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:16.509394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871006e6-ec9e-4e49-ac8a-a75d00c8357d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:16.511975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-871006e6-ec9e-4e49-ac8a-a75d00c8357d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:16.522531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549346d-7069-49f7-98c7-67e9b23b0b3b service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:16.527666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871006e6-ec9e-4e49-ac8a-a75d00c8357d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:16.535520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:16.538133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967e15-ffe6-49d2-94ba-308770380138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:16.539007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:16.539130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967e15-ffe6-49d2-94ba-308770380138 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:16.540291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:16.540790 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967e15-ffe6-49d2-94ba-308770380138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:16.541103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] PATH_INFO: `/v3/users/f365b78d51cb4102b172886089199d67` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:16.541408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967e15-ffe6-49d2-94ba-308770380138 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:16.542166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78967e15-ffe6-49d2-94ba-308770380138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:16.544897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f365b78d51cb4102b172886089199d67)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:16.547681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78967e15-ffe6-49d2-94ba-308770380138 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:16.550573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:16.601297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 847/1696] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:16 2022] POST /identity/v3/users => generated 302 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:16.603615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967e15-ffe6-49d2-94ba-308770380138 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:16.631494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967e15-ffe6-49d2-94ba-308770380138 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:16.643719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81e88e-fce9-4ea3-a7a9-2c9b833f0168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:16.644840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81e88e-fce9-4ea3-a7a9-2c9b833f0168 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:16.645981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81e88e-fce9-4ea3-a7a9-2c9b833f0168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:16.646848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81e88e-fce9-4ea3-a7a9-2c9b833f0168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:16.654262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:16.662295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f365b78d51cb4102b172886089199d67'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:16.663499 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f365b78d51cb4102b172886089199d67'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:16.665123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81e88e-fce9-4ea3-a7a9-2c9b833f0168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:16.667215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81e88e-fce9-4ea3-a7a9-2c9b833f0168 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:16.680624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 848/1697] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:16.682321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81e88e-fce9-4ea3-a7a9-2c9b833f0168 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:16.698178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81e88e-fce9-4ea3-a7a9-2c9b833f0168 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:16.708239 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f2d8e-7f96-40c4-af78-82e7abab1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:16.708239 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2d8e-7f96-40c4-af78-82e7abab1d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:16.708239 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2d8e-7f96-40c4-af78-82e7abab1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:16.708239 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f2d8e-7f96-40c4-af78-82e7abab1d67 admin admin] PATH_INFO: `/v3/projects/f02fbc602bc74ffa82b1e6b36c28a9b0/users/278227f9a91c4991abd685a935189259/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:16.713830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f365b78d51cb4102b172886089199d67'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:16.730576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f2d8e-7f96-40c4-af78-82e7abab1d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02fbc602bc74ffa82b1e6b36c28a9b0, user_id=278227f9a91c4991abd685a935189259, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:16.733249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f365b78d51cb4102b172886089199d67'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:16.734957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f2d8e-7f96-40c4-af78-82e7abab1d67 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:16.735846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f41ba510-5be1-4166-ae4d-378b6fcec15e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f365b78d51cb4102b172886089199d67'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:16.777004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 849/1698] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:16 2022] PUT /identity/v3/projects/f02fbc602bc74ffa82b1e6b36c28a9b0/users/278227f9a91c4991abd685a935189259/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:16.777004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f2d8e-7f96-40c4-af78-82e7abab1d67 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:16.777441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 850/1699] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:16 2022] DELETE /identity/v3/users/f365b78d51cb4102b172886089199d67 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:16.777535 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-781f2d8e-7f96-40c4-af78-82e7abab1d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:16.777607 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b6e2-5bd2-4d20-975b-d84e9f50d9e6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:16.777820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b6e2-5bd2-4d20-975b-d84e9f50d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:16.778116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b6e2-5bd2-4d20-975b-d84e9f50d9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:16.839211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8790b6e2-5bd2-4d20-975b-d84e9f50d9e6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:16.844340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8790b6e2-5bd2-4d20-975b-d84e9f50d9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:16.981356 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f2d8e-7f96-40c4-af78-82e7abab1d67 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:16.997936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 851/1700] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:17.000711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02d8f-d2ee-4e39-a511-2c94194088cc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:17.000711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02d8f-d2ee-4e39-a511-2c94194088cc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:17.000711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f02d8f-d2ee-4e39-a511-2c94194088cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:17.034416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:17.084820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b2f02d8f-d2ee-4e39-a511-2c94194088cc None None] MFA Rules not processed for user `278227f9a91c4991abd685a935189259`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:17.086517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b2f02d8f-d2ee-4e39-a511-2c94194088cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:17.139290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80336d6a-3b2a-48f0-ad48-d1de316b771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:17.144794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80336d6a-3b2a-48f0-ad48-d1de316b771c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:17.144794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80336d6a-3b2a-48f0-ad48-d1de316b771c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:17.144794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80336d6a-3b2a-48f0-ad48-d1de316b771c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:17.144794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80336d6a-3b2a-48f0-ad48-d1de316b771c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:17.150508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80336d6a-3b2a-48f0-ad48-d1de316b771c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:17.173525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 850/1701] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:17.174869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb648-0d73-4590-a840-f42246efa3bc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:17.177266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb648-0d73-4590-a840-f42246efa3bc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:17.178038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb648-0d73-4590-a840-f42246efa3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:17.267567 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0ffcb648-0d73-4590-a840-f42246efa3bc None None] MFA Rules not processed for user `53327160ebb04585b414ad1571259834`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:17.268908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0ffcb648-0d73-4590-a840-f42246efa3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:17.340505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 852/1702] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:17.344142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f02d8f-d2ee-4e39-a511-2c94194088cc None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:17.347372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b2f02d8f-d2ee-4e39-a511-2c94194088cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:17.426215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 851/1703] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:17.427303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb648-0d73-4590-a840-f42246efa3bc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:17.461744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb648-0d73-4590-a840-f42246efa3bc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:17.483632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9cddc-24b4-4fee-baa1-a007e6073222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:17.486191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9cddc-24b4-4fee-baa1-a007e6073222 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:17.486792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9cddc-24b4-4fee-baa1-a007e6073222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:17.488254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9cddc-24b4-4fee-baa1-a007e6073222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:17.490089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9cddc-24b4-4fee-baa1-a007e6073222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:17.494928 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9cddc-24b4-4fee-baa1-a007e6073222 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:17.514084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f02d8f-d2ee-4e39-a511-2c94194088cc None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:17.524352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ea79-0c29-4135-a146-1205d2e8f4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:17.525698 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ea79-0c29-4135-a146-1205d2e8f4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:17.526477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 852/1704] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:17.528092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ea79-0c29-4135-a146-1205d2e8f4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:17.528751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ea79-0c29-4135-a146-1205d2e8f4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:17.529653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9cddc-24b4-4fee-baa1-a007e6073222 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:17.535000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2fd9cddc-24b4-4fee-baa1-a007e6073222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:17.550285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:17.555675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ea79-0c29-4135-a146-1205d2e8f4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:17.558524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ea79-0c29-4135-a146-1205d2e8f4c0 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:17.568136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9cddc-24b4-4fee-baa1-a007e6073222 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:17.584601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed91cb-3584-4278-86f4-12cd40ec0db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:17.585384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed91cb-3584-4278-86f4-12cd40ec0db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:17.587829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed91cb-3584-4278-86f4-12cd40ec0db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:17.588390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed91cb-3584-4278-86f4-12cd40ec0db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:17.589173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed91cb-3584-4278-86f4-12cd40ec0db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:17.589594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 853/1705] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:17.590590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ea79-0c29-4135-a146-1205d2e8f4c0 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:17.594456 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b697ea79-0c29-4135-a146-1205d2e8f4c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:17.595812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed91cb-3584-4278-86f4-12cd40ec0db5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:17.670883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 853/1706] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:17 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:17.673178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed91cb-3584-4278-86f4-12cd40ec0db5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:17.747407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ea79-0c29-4135-a146-1205d2e8f4c0 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:17.835350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e19785-b124-4f16-9256-a8c9cfe8ce8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:17.835350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19785-b124-4f16-9256-a8c9cfe8ce8f service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:17.835350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19785-b124-4f16-9256-a8c9cfe8ce8f service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:17.835350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e19785-b124-4f16-9256-a8c9cfe8ce8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:17.839090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed91cb-3584-4278-86f4-12cd40ec0db5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:17.852610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82df2f-29ff-41e8-a22d-9969a192a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:17.856054 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82df2f-29ff-41e8-a22d-9969a192a44d admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:17.856564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82df2f-29ff-41e8-a22d-9969a192a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:17.857016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82df2f-29ff-41e8-a22d-9969a192a44d admin admin] PATH_INFO: `/v3/projects/e0b86449db504d0598f29e9c5667e73f/users/568299acdd3a471d9625c3630611ac70/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:17.883952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82df2f-29ff-41e8-a22d-9969a192a44d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b86449db504d0598f29e9c5667e73f, user_id=568299acdd3a471d9625c3630611ac70, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:17.900766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82df2f-29ff-41e8-a22d-9969a192a44d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:17.904748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:17.915214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 854/1707] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:17 2022] PUT /identity/v3/projects/e0b86449db504d0598f29e9c5667e73f/users/568299acdd3a471d9625c3630611ac70/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:17.916628 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82df2f-29ff-41e8-a22d-9969a192a44d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:17.918571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6e82df2f-29ff-41e8-a22d-9969a192a44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:17.948273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e19785-b124-4f16-9256-a8c9cfe8ce8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:17.950363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e19785-b124-4f16-9256-a8c9cfe8ce8f service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:17.964520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 854/1708] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:17.965930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e19785-b124-4f16-9256-a8c9cfe8ce8f service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:17.979557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e19785-b124-4f16-9256-a8c9cfe8ce8f service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:18.011075 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:18.062489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de903cf7-79fb-48d4-b693-af2fc0721539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:18.063855 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903cf7-79fb-48d4-b693-af2fc0721539 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:18.064249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903cf7-79fb-48d4-b693-af2fc0721539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:18.064917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903cf7-79fb-48d4-b693-af2fc0721539 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:18.066048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de903cf7-79fb-48d4-b693-af2fc0721539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:18.069147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de903cf7-79fb-48d4-b693-af2fc0721539 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:18.105305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 855/1709] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:17 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:18.105305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac1b5-4675-447c-becc-c1bd18df8497 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:18.105305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac1b5-4675-447c-becc-c1bd18df8497 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:18.105305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac1b5-4675-447c-becc-c1bd18df8497 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:18.106349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 856/1710] 10.222.0.81 () {54 vars in 961 bytes} [Thu Aug 18 17:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:04:18.107558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968935e9-f384-4f96-a162-1b4417e67f14 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:18.107905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968935e9-f384-4f96-a162-1b4417e67f14 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:18.108418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968935e9-f384-4f96-a162-1b4417e67f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:18.152052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-968935e9-f384-4f96-a162-1b4417e67f14 None None] MFA Rules not processed for user `568299acdd3a471d9625c3630611ac70`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:18.161494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-968935e9-f384-4f96-a162-1b4417e67f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:18.222332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82df2f-29ff-41e8-a22d-9969a192a44d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:18.240725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:18.245296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:18.246746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:18.247043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] PATH_INFO: `/v3/projects/98c9936461d14064953dbe8bb6458391` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:18.255348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c9936461d14064953dbe8bb6458391)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:18.269566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:18.294863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 857/1711] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:18.296494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968935e9-f384-4f96-a162-1b4417e67f14 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:18.332823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968935e9-f384-4f96-a162-1b4417e67f14 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:18.347102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a1ec4-c49e-4e50-ae7b-ed01e0d0f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:18.349089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1ec4-c49e-4e50-ae7b-ed01e0d0f5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:18.349396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1ec4-c49e-4e50-ae7b-ed01e0d0f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:18.349677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a1ec4-c49e-4e50-ae7b-ed01e0d0f5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:18.351510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a1ec4-c49e-4e50-ae7b-ed01e0d0f5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:18.355839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a1ec4-c49e-4e50-ae7b-ed01e0d0f5a6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:18.396695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 858/1712] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:18.400420 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b53a1-49c9-4fce-9945-62c73f3398d0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:18.401514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b53a1-49c9-4fce-9945-62c73f3398d0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:18.403266 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b53a1-49c9-4fce-9945-62c73f3398d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:18.440580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c9936461d14064953dbe8bb6458391', 'request_id': 'req-8428bc17-eb03-45e4-aaeb-775fab4790f6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:18.454407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-347b53a1-49c9-4fce-9945-62c73f3398d0 None None] MFA Rules not processed for user `4cc1ad7e47454b5d9d2ef2190414010c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:18.456720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-347b53a1-49c9-4fce-9945-62c73f3398d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:18.456856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c9936461d14064953dbe8bb6458391', 'request_id': 'req-8428bc17-eb03-45e4-aaeb-775fab4790f6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:18.474961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c9936461d14064953dbe8bb6458391', 'request_id': 'req-8428bc17-eb03-45e4-aaeb-775fab4790f6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:18.504492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] The token cache is being invalidate because project 98c9936461d14064953dbe8bb6458391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:18.504986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:18.507348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:18.511947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 855/1713] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:17 2022] DELETE /identity/v3/projects/98c9936461d14064953dbe8bb6458391 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:18.514401 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:18.516698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:18.647008 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 859/1714] 10.222.0.81 () {58 vars in 1058 bytes} [Thu Aug 18 17:04:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:18.649080 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b53a1-49c9-4fce-9945-62c73f3398d0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:18.654917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-347b53a1-49c9-4fce-9945-62c73f3398d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:18.712971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428bc17-eb03-45e4-aaeb-775fab4790f6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:18.725281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcc200-27d1-4e85-ad20-b01d9438c27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:18.725933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcc200-27d1-4e85-ad20-b01d9438c27b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:18.726206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcc200-27d1-4e85-ad20-b01d9438c27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:18.726474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcc200-27d1-4e85-ad20-b01d9438c27b admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:18.729887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcc200-27d1-4e85-ad20-b01d9438c27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:18.738946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcc200-27d1-4e85-ad20-b01d9438c27b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:18.766506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:18.817542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 856/1715] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:18 2022] POST /identity/v3/projects => generated 405 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:18.821639 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcc200-27d1-4e85-ad20-b01d9438c27b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:18.824966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-06dcc200-27d1-4e85-ad20-b01d9438c27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:18.851012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b53a1-49c9-4fce-9945-62c73f3398d0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:18.872582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:19.076815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcc200-27d1-4e85-ad20-b01d9438c27b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:19.093879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e57431-e8a0-430c-963f-354243600a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:19.110411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:19.111272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:19.111729 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:19.112113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] PATH_INFO: `/v3/users/36a0935f206c4003afa81631573a331b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:19.113519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e57431-e8a0-430c-963f-354243600a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:19.115126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e57431-e8a0-430c-963f-354243600a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:19.115788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e57431-e8a0-430c-963f-354243600a40 admin admin] PATH_INFO: `/v3/projects/ec27291c19c14f9d831297948a9cbff1/users/42993186b2c94409b131b57401647750/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:19.118937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a0935f206c4003afa81631573a331b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:19.126952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:19.147991 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e57431-e8a0-430c-963f-354243600a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec27291c19c14f9d831297948a9cbff1, user_id=42993186b2c94409b131b57401647750, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:19.153331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e57431-e8a0-430c-963f-354243600a40 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:19.187756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 860/1716] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:18 2022] PUT /identity/v3/projects/ec27291c19c14f9d831297948a9cbff1/users/42993186b2c94409b131b57401647750/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:19.189313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e57431-e8a0-430c-963f-354243600a40 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:19.272095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a0935f206c4003afa81631573a331b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:19.293208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a0935f206c4003afa81631573a331b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:19.293880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a0935f206c4003afa81631573a331b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:19.294532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a0935f206c4003afa81631573a331b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:19.306903 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a0935f206c4003afa81631573a331b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:19.317655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e57431-e8a0-430c-963f-354243600a40 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:19.334878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e49da1-f0c0-4853-a1d2-34a1e3ae1ba5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:19.337904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e49da1-f0c0-4853-a1d2-34a1e3ae1ba5 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:19.338792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e49da1-f0c0-4853-a1d2-34a1e3ae1ba5 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:19.339296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e49da1-f0c0-4853-a1d2-34a1e3ae1ba5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:19.341797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-90e49da1-f0c0-4853-a1d2-34a1e3ae1ba5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:19.352340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 857/1717] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:18 2022] DELETE /identity/v3/users/36a0935f206c4003afa81631573a331b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:19.357648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:19.360312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:19.370357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e49da1-f0c0-4853-a1d2-34a1e3ae1ba5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:19.376697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e49da1-f0c0-4853-a1d2-34a1e3ae1ba5 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:19.412176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 861/1718] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:19.413150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e49da1-f0c0-4853-a1d2-34a1e3ae1ba5 service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:19.418981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-90e49da1-f0c0-4853-a1d2-34a1e3ae1ba5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:19.624565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:19.654867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d742-dc5c-4f1a-8e2d-660973a22fe1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:19.665276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e49da1-f0c0-4853-a1d2-34a1e3ae1ba5 service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:19.676091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba93c4-5b81-40ff-9616-6021588245ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:19.677353 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba93c4-5b81-40ff-9616-6021588245ee admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:19.677790 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba93c4-5b81-40ff-9616-6021588245ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:19.678139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba93c4-5b81-40ff-9616-6021588245ee admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:19.678892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba93c4-5b81-40ff-9616-6021588245ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:19.680110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241386c6-8fb8-4147-96ab-27c78bcc61f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:19.681396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241386c6-8fb8-4147-96ab-27c78bcc61f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:19.684371 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241386c6-8fb8-4147-96ab-27c78bcc61f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:19.685414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241386c6-8fb8-4147-96ab-27c78bcc61f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:19.691536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241386c6-8fb8-4147-96ab-27c78bcc61f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:19.693968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba93c4-5b81-40ff-9616-6021588245ee admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:19.705845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241386c6-8fb8-4147-96ab-27c78bcc61f2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:19.761485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 862/1719] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:19.762469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241386c6-8fb8-4147-96ab-27c78bcc61f2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:19.804261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 858/1720] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:19 2022] POST /identity/v3/users => generated 309 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:19.805490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba93c4-5b81-40ff-9616-6021588245ee admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:19.809931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-78ba93c4-5b81-40ff-9616-6021588245ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:19.814910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241386c6-8fb8-4147-96ab-27c78bcc61f2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:19.830089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e92206-b1d2-4e79-b7a2-a7a05512a877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:19.830797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e92206-b1d2-4e79-b7a2-a7a05512a877 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:19.831094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e92206-b1d2-4e79-b7a2-a7a05512a877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:19.831374 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e92206-b1d2-4e79-b7a2-a7a05512a877 admin admin] PATH_INFO: `/v3/projects/ec27291c19c14f9d831297948a9cbff1/users/42993186b2c94409b131b57401647750/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:19.843301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba93c4-5b81-40ff-9616-6021588245ee admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:19.849067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e92206-b1d2-4e79-b7a2-a7a05512a877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec27291c19c14f9d831297948a9cbff1, user_id=42993186b2c94409b131b57401647750, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:19.855439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e92206-b1d2-4e79-b7a2-a7a05512a877 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:19.859449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:19.860281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:19.860697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:19.861080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] PATH_INFO: `/v3/projects/c8f3e69008e24b4f8a8223ed8e39935d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:19.863836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f3e69008e24b4f8a8223ed8e39935d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:19.867464 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:19.897248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 863/1721] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:19 2022] PUT /identity/v3/projects/ec27291c19c14f9d831297948a9cbff1/users/42993186b2c94409b131b57401647750/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:19.905213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e92206-b1d2-4e79-b7a2-a7a05512a877 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:19.988183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:20.071551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f3e69008e24b4f8a8223ed8e39935d', 'request_id': 'req-7adf95e6-e82e-4568-821d-9c16d644142d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:20.101986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f3e69008e24b4f8a8223ed8e39935d', 'request_id': 'req-7adf95e6-e82e-4568-821d-9c16d644142d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:20.128622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f3e69008e24b4f8a8223ed8e39935d', 'request_id': 'req-7adf95e6-e82e-4568-821d-9c16d644142d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:20.136096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e92206-b1d2-4e79-b7a2-a7a05512a877 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:20.163750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] The token cache is being invalidate because project c8f3e69008e24b4f8a8223ed8e39935d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:20.166863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:20.170296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7adf95e6-e82e-4568-821d-9c16d644142d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:20.173750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 859/1722] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:19 2022] DELETE /identity/v3/projects/c8f3e69008e24b4f8a8223ed8e39935d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:20.183702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618ba01-97a4-4edf-b818-0318ef399f8d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:20.184817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618ba01-97a4-4edf-b818-0318ef399f8d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:20.186255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618ba01-97a4-4edf-b818-0318ef399f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:20.302872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d618ba01-97a4-4edf-b818-0318ef399f8d None None] MFA Rules not processed for user `42993186b2c94409b131b57401647750`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:20.308401 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d618ba01-97a4-4edf-b818-0318ef399f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:20.313703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbe61a-b28d-4614-959f-2ad61c084628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:20.314769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbe61a-b28d-4614-959f-2ad61c084628 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:20.315013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbe61a-b28d-4614-959f-2ad61c084628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:20.315295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbe61a-b28d-4614-959f-2ad61c084628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:20.316003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbe61a-b28d-4614-959f-2ad61c084628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:20.325354 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbe61a-b28d-4614-959f-2ad61c084628 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:20.348540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 864/1723] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:20.349496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbe61a-b28d-4614-959f-2ad61c084628 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:20.356252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-00fbe61a-b28d-4614-959f-2ad61c084628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:20.394205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbe61a-b28d-4614-959f-2ad61c084628 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:20.409340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:20.410012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:20.410319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:20.410549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] PATH_INFO: `/v3/users/f64386f08f574c2a8539f604a7fa6d26` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:20.416368 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64386f08f574c2a8539f604a7fa6d26)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:20.418867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:20.545599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 860/1724] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:20.547805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618ba01-97a4-4edf-b818-0318ef399f8d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:20.549101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64386f08f574c2a8539f604a7fa6d26'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:20.550122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64386f08f574c2a8539f604a7fa6d26'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:20.556103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d618ba01-97a4-4edf-b818-0318ef399f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:20.635884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64386f08f574c2a8539f604a7fa6d26'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:20.641025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618ba01-97a4-4edf-b818-0318ef399f8d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:20.669528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76c0f-734c-4b99-b89b-f2c2f5bb1bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:20.672053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64386f08f574c2a8539f604a7fa6d26'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:20.673717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76c0f-734c-4b99-b89b-f2c2f5bb1bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:20.674014 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76c0f-734c-4b99-b89b-f2c2f5bb1bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:20.674288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76c0f-734c-4b99-b89b-f2c2f5bb1bb7 admin admin] PATH_INFO: `/v3/projects/17e6ac5f3ba044e796c2cecc61f4536f/users/e8962468bfab49498f14ba218f662896/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:20.677292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64386f08f574c2a8539f604a7fa6d26'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:20.686527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:20.716753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 865/1725] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:20 2022] DELETE /identity/v3/users/f64386f08f574c2a8539f604a7fa6d26 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:20.720489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:20.731891 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:20.747827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76c0f-734c-4b99-b89b-f2c2f5bb1bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e6ac5f3ba044e796c2cecc61f4536f, user_id=e8962468bfab49498f14ba218f662896, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:20.751000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76c0f-734c-4b99-b89b-f2c2f5bb1bb7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:20.773383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 861/1726] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:20 2022] PUT /identity/v3/projects/17e6ac5f3ba044e796c2cecc61f4536f/users/e8962468bfab49498f14ba218f662896/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:20.774935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a351bd-7633-4d70-8ae4-22303cc5df83 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:20.775437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a351bd-7633-4d70-8ae4-22303cc5df83 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:20.776006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a351bd-7633-4d70-8ae4-22303cc5df83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:20.839388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f8a351bd-7633-4d70-8ae4-22303cc5df83 None None] MFA Rules not processed for user `368cddc3968c4c39b7ca05c500872b45`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:20.840835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f8a351bd-7633-4d70-8ae4-22303cc5df83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:20.950789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b770d92-9864-435c-9be6-c85ae6f6d42b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:21.026039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 862/1727] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:21.027379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a351bd-7633-4d70-8ae4-22303cc5df83 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:21.032814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f8a351bd-7633-4d70-8ae4-22303cc5df83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:21.065283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:21.110580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985e50c-f8a8-4b1d-97b3-2325cc1a8e01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:21.111220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e50c-f8a8-4b1d-97b3-2325cc1a8e01 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:21.111500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e50c-f8a8-4b1d-97b3-2325cc1a8e01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:21.111777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e50c-f8a8-4b1d-97b3-2325cc1a8e01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:21.133435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2985e50c-f8a8-4b1d-97b3-2325cc1a8e01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:21.191879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a351bd-7633-4d70-8ae4-22303cc5df83 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:21.204353 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:21.205301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:21.205651 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:21.206067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] PATH_INFO: `/v3/projects/4603db70ebd24abe949d8e11d932b181` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:21.211106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4603db70ebd24abe949d8e11d932b181)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:21.215413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:21.255278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985e50c-f8a8-4b1d-97b3-2325cc1a8e01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:21.257417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985e50c-f8a8-4b1d-97b3-2325cc1a8e01 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:21.274266 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 866/1728] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:21.276043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985e50c-f8a8-4b1d-97b3-2325cc1a8e01 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:21.277937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2985e50c-f8a8-4b1d-97b3-2325cc1a8e01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:21.303220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985e50c-f8a8-4b1d-97b3-2325cc1a8e01 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:21.339190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4603db70ebd24abe949d8e11d932b181', 'request_id': 'req-50883ffb-96ae-4fca-840f-9653ce11dee7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:21.359020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4603db70ebd24abe949d8e11d932b181', 'request_id': 'req-50883ffb-96ae-4fca-840f-9653ce11dee7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:21.369321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4603db70ebd24abe949d8e11d932b181', 'request_id': 'req-50883ffb-96ae-4fca-840f-9653ce11dee7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:21.398731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] The token cache is being invalidate because project 4603db70ebd24abe949d8e11d932b181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:21.398731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:21.399970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50883ffb-96ae-4fca-840f-9653ce11dee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:21.403333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 863/1729] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:21 2022] DELETE /identity/v3/projects/4603db70ebd24abe949d8e11d932b181 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:21.408958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae85c43-1bb1-4634-810f-ba9470a889ca None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:21.409239 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae85c43-1bb1-4634-810f-ba9470a889ca None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:21.409532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae85c43-1bb1-4634-810f-ba9470a889ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:21.439970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:21.447477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5ae85c43-1bb1-4634-810f-ba9470a889ca None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:21.449410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5ae85c43-1bb1-4634-810f-ba9470a889ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:21.456804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85febc77-9d14-4317-905d-3efd5ba8b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:21.458744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85febc77-9d14-4317-905d-3efd5ba8b487 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:21.459017 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85febc77-9d14-4317-905d-3efd5ba8b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:21.459299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85febc77-9d14-4317-905d-3efd5ba8b487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:21.461168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85febc77-9d14-4317-905d-3efd5ba8b487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:21.462834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85febc77-9d14-4317-905d-3efd5ba8b487 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:21.506391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 864/1730] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:21.511036 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10872b-62f4-4693-9703-81e531861448 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:21.511482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10872b-62f4-4693-9703-81e531861448 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:21.511763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10872b-62f4-4693-9703-81e531861448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:21.529715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 867/1731] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:21.533637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85febc77-9d14-4317-905d-3efd5ba8b487 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:21.541108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-85febc77-9d14-4317-905d-3efd5ba8b487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:21.573078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85febc77-9d14-4317-905d-3efd5ba8b487 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:21.601587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebaab9-8ef6-4e53-bc72-858a83966121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:21.602348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebaab9-8ef6-4e53-bc72-858a83966121 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:21.602847 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebaab9-8ef6-4e53-bc72-858a83966121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:21.603577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebaab9-8ef6-4e53-bc72-858a83966121 admin admin] PATH_INFO: `/v3/projects/17e6ac5f3ba044e796c2cecc61f4536f/users/e8962468bfab49498f14ba218f662896/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:21.604584 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fd10872b-62f4-4693-9703-81e531861448 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:21.606989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fd10872b-62f4-4693-9703-81e531861448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:21.607850 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebaab9-8ef6-4e53-bc72-858a83966121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e6ac5f3ba044e796c2cecc61f4536f, user_id=e8962468bfab49498f14ba218f662896, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:21.627466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 865/1732] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:21.628258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebaab9-8ef6-4e53-bc72-858a83966121 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:21.631363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10872b-62f4-4693-9703-81e531861448 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:21.674047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10872b-62f4-4693-9703-81e531861448 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:21.688666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 868/1733] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:21 2022] PUT /identity/v3/projects/17e6ac5f3ba044e796c2cecc61f4536f/users/e8962468bfab49498f14ba218f662896/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:21.705332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c596-798e-4041-94ec-d4f3c9400a87 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:21.705885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c596-798e-4041-94ec-d4f3c9400a87 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:21.706355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c596-798e-4041-94ec-d4f3c9400a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:21.858505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5911c596-798e-4041-94ec-d4f3c9400a87 None None] MFA Rules not processed for user `e8962468bfab49498f14ba218f662896`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:21.863663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5911c596-798e-4041-94ec-d4f3c9400a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:21.933962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c10b3-4837-4236-b2ec-2c95d502842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:21.941252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c10b3-4837-4236-b2ec-2c95d502842c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:21.942007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c10b3-4837-4236-b2ec-2c95d502842c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:21.944124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c10b3-4837-4236-b2ec-2c95d502842c admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:21.947539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c10b3-4837-4236-b2ec-2c95d502842c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:21.949552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c10b3-4837-4236-b2ec-2c95d502842c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:21.958090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c10b3-4837-4236-b2ec-2c95d502842c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:22.031810 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 866/1734] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:22.034223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c10b3-4837-4236-b2ec-2c95d502842c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:22.040227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d53c10b3-4837-4236-b2ec-2c95d502842c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:22.095759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c10b3-4837-4236-b2ec-2c95d502842c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:22.138149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:22.139509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:22.141751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:22.142918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] PATH_INFO: `/v3/projects/068b06f8dd22408781067513ff3f210d` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:22.147994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068b06f8dd22408781067513ff3f210d)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:22.153697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:22.157233 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 869/1735] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:22.166332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911c596-798e-4041-94ec-d4f3c9400a87 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:22.210759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911c596-798e-4041-94ec-d4f3c9400a87 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:22.221453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8cb2e-497e-4db6-92af-b938c435a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:22.226167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8cb2e-497e-4db6-92af-b938c435a43c admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:22.226448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8cb2e-497e-4db6-92af-b938c435a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:22.227883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8cb2e-497e-4db6-92af-b938c435a43c admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:22.231257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8cb2e-497e-4db6-92af-b938c435a43c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:22.234086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8cb2e-497e-4db6-92af-b938c435a43c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:22.235103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:22.303019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068b06f8dd22408781067513ff3f210d', 'request_id': 'req-14e32160-b580-4620-991a-d3ec16704339'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:22.312923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068b06f8dd22408781067513ff3f210d', 'request_id': 'req-14e32160-b580-4620-991a-d3ec16704339'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:22.328011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068b06f8dd22408781067513ff3f210d', 'request_id': 'req-14e32160-b580-4620-991a-d3ec16704339'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:22.328216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 870/1736] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:22 2022] POST /identity/v3/projects => generated 399 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:22.329104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8cb2e-497e-4db6-92af-b938c435a43c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:22.334244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-36f8cb2e-497e-4db6-92af-b938c435a43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:22.346904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] The token cache is being invalidate because project 068b06f8dd22408781067513ff3f210d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:22.347456 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:22.348113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:22.350139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 867/1737] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:22 2022] DELETE /identity/v3/projects/068b06f8dd22408781067513ff3f210d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:22.350959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:22.352404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:22.515584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8cb2e-497e-4db6-92af-b938c435a43c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:22.529389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c8d97-ac3f-42e9-8779-b3386aafd960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:22.530039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c8d97-ac3f-42e9-8779-b3386aafd960 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:22.530896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c8d97-ac3f-42e9-8779-b3386aafd960 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:22.531270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c8d97-ac3f-42e9-8779-b3386aafd960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:22.535123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8c6c8d97-ac3f-42e9-8779-b3386aafd960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:22.575702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32160-b580-4620-991a-d3ec16704339 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:22.711913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558afa9-11cf-41de-934a-686170199cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:22.713068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558afa9-11cf-41de-934a-686170199cba admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:22.716070 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558afa9-11cf-41de-934a-686170199cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:22.716548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558afa9-11cf-41de-934a-686170199cba admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:22.717322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558afa9-11cf-41de-934a-686170199cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:22.737301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558afa9-11cf-41de-934a-686170199cba admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:22.743214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:22.755318 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c8d97-ac3f-42e9-8779-b3386aafd960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:22.761425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c8d97-ac3f-42e9-8779-b3386aafd960 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:22.785935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 871/1738] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:22 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:22.790188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 868/1739] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:22 2022] POST /identity/v3/users => generated 300 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:22.790827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0d267-e551-4e82-a482-4abefb722a89 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:22.791289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0d267-e551-4e82-a482-4abefb722a89 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:22.791583 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0d267-e551-4e82-a482-4abefb722a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:22.794989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6e4f-1b92-4769-b0e8-a443f3fd0d1f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:22.795285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6e4f-1b92-4769-b0e8-a443f3fd0d1f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:22.795571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6e4f-1b92-4769-b0e8-a443f3fd0d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:22.880549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cfa0d267-e551-4e82-a482-4abefb722a89 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:22.883534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cfa0d267-e551-4e82-a482-4abefb722a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:22.895829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e45d6e4f-1b92-4769-b0e8-a443f3fd0d1f None None] MFA Rules not processed for user `53327160ebb04585b414ad1571259834`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:22.899705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e45d6e4f-1b92-4769-b0e8-a443f3fd0d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:22.912548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 872/1740] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:22.913565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0d267-e551-4e82-a482-4abefb722a89 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:22.954645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0d267-e551-4e82-a482-4abefb722a89 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:22.982263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed20a6-fa49-48a1-bcf0-6b78854cd8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:22.984715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed20a6-fa49-48a1-bcf0-6b78854cd8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:22.985835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed20a6-fa49-48a1-bcf0-6b78854cd8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:22.986218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed20a6-fa49-48a1-bcf0-6b78854cd8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:22.989545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed20a6-fa49-48a1-bcf0-6b78854cd8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:22.992588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed20a6-fa49-48a1-bcf0-6b78854cd8a8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:23.004653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:23.038843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 873/1741] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:23.038843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed20a6-fa49-48a1-bcf0-6b78854cd8a8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:23.044791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 869/1742] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:23.045204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7aed20a6-fa49-48a1-bcf0-6b78854cd8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:23.047275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ff6c1-51f2-4870-9eb3-80a0b8618ddd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:23.047756 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ff6c1-51f2-4870-9eb3-80a0b8618ddd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:23.048219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ff6c1-51f2-4870-9eb3-80a0b8618ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:23.077969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e70ff6c1-51f2-4870-9eb3-80a0b8618ddd None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:23.079573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e70ff6c1-51f2-4870-9eb3-80a0b8618ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:23.093386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 870/1743] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:23.104822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ff6c1-51f2-4870-9eb3-80a0b8618ddd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:23.107211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e70ff6c1-51f2-4870-9eb3-80a0b8618ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:23.134648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed20a6-fa49-48a1-bcf0-6b78854cd8a8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:23.134865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ff6c1-51f2-4870-9eb3-80a0b8618ddd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:23.141184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:23.141800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:23.142081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:23.142351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] PATH_INFO: `/v3/users/568299acdd3a471d9625c3630611ac70` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:23.144037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568299acdd3a471d9625c3630611ac70)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:23.146505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:23.152434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:23.156302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:23.165159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:23.167176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] PATH_INFO: `/v3/users/278227f9a91c4991abd685a935189259` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:23.169582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=278227f9a91c4991abd685a935189259)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:23.172549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:23.236339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568299acdd3a471d9625c3630611ac70'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:23.256211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568299acdd3a471d9625c3630611ac70'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:23.262393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568299acdd3a471d9625c3630611ac70'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:23.264240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568299acdd3a471d9625c3630611ac70'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:23.286319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568299acdd3a471d9625c3630611ac70'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:23.293087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278227f9a91c4991abd685a935189259'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:23.293957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278227f9a91c4991abd685a935189259'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:23.363599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278227f9a91c4991abd685a935189259'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:23.370371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 871/1744] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:23 2022] DELETE /identity/v3/users/568299acdd3a471d9625c3630611ac70 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:23.371339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:23.377794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:23.384577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278227f9a91c4991abd685a935189259'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:23.386607 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278227f9a91c4991abd685a935189259'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:23.433701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 874/1745] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:23 2022] DELETE /identity/v3/users/278227f9a91c4991abd685a935189259 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:23.437560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:23.442269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:23.577421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e0d3-4276-4edc-8e94-b232ef754540 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:23.615965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec7231-0bd4-4f65-aece-b6a1f87ed29c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:23.625982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc027d-7605-4f5b-b718-5884209d26ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:23.626913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc027d-7605-4f5b-b718-5884209d26ac admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:23.627362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc027d-7605-4f5b-b718-5884209d26ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:23.627800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc027d-7605-4f5b-b718-5884209d26ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:23.628732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc027d-7605-4f5b-b718-5884209d26ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:23.629198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc027d-7605-4f5b-b718-5884209d26ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:23.638159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc027d-7605-4f5b-b718-5884209d26ac admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:23.649175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a88f1b-3fa0-4b9a-ae37-16e1e58d3bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:23.649992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a88f1b-3fa0-4b9a-ae37-16e1e58d3bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:23.650332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a88f1b-3fa0-4b9a-ae37-16e1e58d3bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:23.650680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a88f1b-3fa0-4b9a-ae37-16e1e58d3bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:23.651409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a88f1b-3fa0-4b9a-ae37-16e1e58d3bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:23.653352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a88f1b-3fa0-4b9a-ae37-16e1e58d3bbb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:23.656821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:23.664240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 875/1746] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:23.665827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1820-2f67-4416-89b3-8cbb8c518d2f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:23.666276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1820-2f67-4416-89b3-8cbb8c518d2f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:23.666744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1820-2f67-4416-89b3-8cbb8c518d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:23.672872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 872/1747] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:23.675025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b3a7-8439-4da7-a7e6-02ba3a645d8b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:23.675995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b3a7-8439-4da7-a7e6-02ba3a645d8b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:23.676727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b3a7-8439-4da7-a7e6-02ba3a645d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:23.709722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-324c1820-2f67-4416-89b3-8cbb8c518d2f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:23.713558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-324c1820-2f67-4416-89b3-8cbb8c518d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:23.733580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 876/1748] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:23.735184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc3e8-cbc1-4282-aec8-9de0fe3a854c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:23.735694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc3e8-cbc1-4282-aec8-9de0fe3a854c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:23.736178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc3e8-cbc1-4282-aec8-9de0fe3a854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:23.789572 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d1bfc3e8-cbc1-4282-aec8-9de0fe3a854c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:23.793544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d1bfc3e8-cbc1-4282-aec8-9de0fe3a854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:23.816146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 877/1749] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:23.821462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc3e8-cbc1-4282-aec8-9de0fe3a854c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:23.839245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-46f3b3a7-8439-4da7-a7e6-02ba3a645d8b None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:23.843462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-46f3b3a7-8439-4da7-a7e6-02ba3a645d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:23.864090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc3e8-cbc1-4282-aec8-9de0fe3a854c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:23.878455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e5840-2bda-4cc6-9a7e-a54dbd2e4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:23.879423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e5840-2bda-4cc6-9a7e-a54dbd2e4f77 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:23.880517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e5840-2bda-4cc6-9a7e-a54dbd2e4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:23.881010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e5840-2bda-4cc6-9a7e-a54dbd2e4f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:23.881893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e5840-2bda-4cc6-9a7e-a54dbd2e4f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:23.884053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e5840-2bda-4cc6-9a7e-a54dbd2e4f77 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:24.008604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 878/1750] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:23 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:24.009719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e5840-2bda-4cc6-9a7e-a54dbd2e4f77 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:24.014022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6d5e5840-2bda-4cc6-9a7e-a54dbd2e4f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:24.027632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 873/1751] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:04:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:24.028766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3b3a7-8439-4da7-a7e6-02ba3a645d8b None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:24.030984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-46f3b3a7-8439-4da7-a7e6-02ba3a645d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:24.063539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:24.178034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3b3a7-8439-4da7-a7e6-02ba3a645d8b None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:24.185023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e5840-2bda-4cc6-9a7e-a54dbd2e4f77 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:24.192193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafaa62-685b-4c2a-9eaf-6475461f60b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:24.193088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafaa62-685b-4c2a-9eaf-6475461f60b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.193376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafaa62-685b-4c2a-9eaf-6475461f60b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.193808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafaa62-685b-4c2a-9eaf-6475461f60b2 admin admin] PATH_INFO: `/v3/projects/cc7cc6bf93ac49fe85720032b627cb7f/users/4c6e188de16b4442aed572c12035d493/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.223478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafaa62-685b-4c2a-9eaf-6475461f60b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7cc6bf93ac49fe85720032b627cb7f, user_id=4c6e188de16b4442aed572c12035d493, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:24.226853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafaa62-685b-4c2a-9eaf-6475461f60b2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:24.247440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 879/1752] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:24 2022] PUT /identity/v3/projects/cc7cc6bf93ac49fe85720032b627cb7f/users/4c6e188de16b4442aed572c12035d493/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:24.262447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafaa62-685b-4c2a-9eaf-6475461f60b2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:24.263684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ead9c0-7d02-4892-b5d9-ceceea4bc1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:24.264446 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ead9c0-7d02-4892-b5d9-ceceea4bc1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.265434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ead9c0-7d02-4892-b5d9-ceceea4bc1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.265785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ead9c0-7d02-4892-b5d9-ceceea4bc1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.277176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ead9c0-7d02-4892-b5d9-ceceea4bc1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:24.279390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ead9c0-7d02-4892-b5d9-ceceea4bc1a7 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:24.295945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 874/1753] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:24.297740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ead9c0-7d02-4892-b5d9-ceceea4bc1a7 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:24.311895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ead9c0-7d02-4892-b5d9-ceceea4bc1a7 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:24.340193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafaa62-685b-4c2a-9eaf-6475461f60b2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:24.345141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceea1a4-cddd-4bc0-8506-14ae7b04f5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:24.345873 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceea1a4-cddd-4bc0-8506-14ae7b04f5fc service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.346551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:24.346885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceea1a4-cddd-4bc0-8506-14ae7b04f5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.347262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceea1a4-cddd-4bc0-8506-14ae7b04f5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.386472 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523b843-3aa8-49bc-92a6-6c1e4b6b456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:24.387139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523b843-3aa8-49bc-92a6-6c1e4b6b456a admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.387527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523b843-3aa8-49bc-92a6-6c1e4b6b456a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.387810 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523b843-3aa8-49bc-92a6-6c1e4b6b456a admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.390540 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523b843-3aa8-49bc-92a6-6c1e4b6b456a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:24.393190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523b843-3aa8-49bc-92a6-6c1e4b6b456a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:24.421298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 875/1754] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:24 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:24.425219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523b843-3aa8-49bc-92a6-6c1e4b6b456a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:24.427132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0523b843-3aa8-49bc-92a6-6c1e4b6b456a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:24.427998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceea1a4-cddd-4bc0-8506-14ae7b04f5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:24.430204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceea1a4-cddd-4bc0-8506-14ae7b04f5fc service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:24.446842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 880/1755] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:24.448190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993d5b2-92e3-4e5b-9bb0-8cb49651136a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.448992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993d5b2-92e3-4e5b-9bb0-8cb49651136a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.448992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993d5b2-92e3-4e5b-9bb0-8cb49651136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.500231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b993d5b2-92e3-4e5b-9bb0-8cb49651136a None None] MFA Rules not processed for user `4c6e188de16b4442aed572c12035d493`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:24.502145 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b993d5b2-92e3-4e5b-9bb0-8cb49651136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:24.556215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:24.564524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523b843-3aa8-49bc-92a6-6c1e4b6b456a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:24.572034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06043f4-b2d3-4bd5-8c11-0715a48325e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:24.573426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06043f4-b2d3-4bd5-8c11-0715a48325e3 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.573909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06043f4-b2d3-4bd5-8c11-0715a48325e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.574377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06043f4-b2d3-4bd5-8c11-0715a48325e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.635409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 881/1756] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:24.637747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7b782-b520-432d-ace7-e3d945306339 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.638241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7b782-b520-432d-ace7-e3d945306339 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.638464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7b782-b520-432d-ace7-e3d945306339 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.640578 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 882/1757] 10.222.0.81 () {54 vars in 912 bytes} [Thu Aug 18 17:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:04:24.641385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7b782-b520-432d-ace7-e3d945306339 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:24.657960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7b782-b520-432d-ace7-e3d945306339 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:24.664907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577182d-06e1-4932-bf3c-59932d7043d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:24.667799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577182d-06e1-4932-bf3c-59932d7043d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.668086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577182d-06e1-4932-bf3c-59932d7043d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.668365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577182d-06e1-4932-bf3c-59932d7043d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.669058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577182d-06e1-4932-bf3c-59932d7043d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:24.671872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577182d-06e1-4932-bf3c-59932d7043d0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:24.689585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 883/1758] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:24.689585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577182d-06e1-4932-bf3c-59932d7043d0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:24.690148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06043f4-b2d3-4bd5-8c11-0715a48325e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:24.692473 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06043f4-b2d3-4bd5-8c11-0715a48325e3 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:24.701925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577182d-06e1-4932-bf3c-59932d7043d0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:24.710966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecef95a-cf9f-427a-9fb7-b72e5d7a3897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:24.710966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecef95a-cf9f-427a-9fb7-b72e5d7a3897 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.711400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecef95a-cf9f-427a-9fb7-b72e5d7a3897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.711400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecef95a-cf9f-427a-9fb7-b72e5d7a3897 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.712105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecef95a-cf9f-427a-9fb7-b72e5d7a3897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:24.713694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 876/1759] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:04:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:04:24.715678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06822-6425-4176-bb24-b93bc10ab2bc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.716085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06822-6425-4176-bb24-b93bc10ab2bc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.716505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06822-6425-4176-bb24-b93bc10ab2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.732525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecef95a-cf9f-427a-9fb7-b72e5d7a3897 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:24.772946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a1c06822-6425-4176-bb24-b93bc10ab2bc None None] MFA Rules not processed for user `7b1fde904acd460899d8c736f5762056`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:24.774051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a1c06822-6425-4176-bb24-b93bc10ab2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:24.803232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 884/1761] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:24 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:24.804427 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecef95a-cf9f-427a-9fb7-b72e5d7a3897 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:24.804996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 877/1761] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:24.808325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c06822-6425-4176-bb24-b93bc10ab2bc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:24.836136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c06822-6425-4176-bb24-b93bc10ab2bc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:24.912951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:24.958418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecef95a-cf9f-427a-9fb7-b72e5d7a3897 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:24.979542 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092896e-4c42-4d2e-a42e-acabb9775588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:24.980241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092896e-4c42-4d2e-a42e-acabb9775588 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.982380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092896e-4c42-4d2e-a42e-acabb9775588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.984445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092896e-4c42-4d2e-a42e-acabb9775588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.985270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092896e-4c42-4d2e-a42e-acabb9775588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:24.987997 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092896e-4c42-4d2e-a42e-acabb9775588 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:24.990625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c592739-46e1-4947-9814-855851139103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:24.991261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c592739-46e1-4947-9814-855851139103 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:24.991541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c592739-46e1-4947-9814-855851139103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:24.991819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c592739-46e1-4947-9814-855851139103 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:24.999420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c592739-46e1-4947-9814-855851139103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:25.001634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c592739-46e1-4947-9814-855851139103 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:25.071270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 885/1762] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:25.072252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092896e-4c42-4d2e-a42e-acabb9775588 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:25.084905 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 878/1763] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:24 2022] POST /identity/v3/users => generated 306 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:25.086105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c592739-46e1-4947-9814-855851139103 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:25.106901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c592739-46e1-4947-9814-855851139103 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:25.137371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad85e7-8889-4dc6-85d9-74156fa4facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:25.138005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad85e7-8889-4dc6-85d9-74156fa4facb admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:25.140678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad85e7-8889-4dc6-85d9-74156fa4facb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:25.141003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad85e7-8889-4dc6-85d9-74156fa4facb admin admin] PATH_INFO: `/v3/projects/e66aec437bf04ce7a98336fe78c3056c/users/134807c9df7845c0a94a8e831011f8d0/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:25.205296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad85e7-8889-4dc6-85d9-74156fa4facb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66aec437bf04ce7a98336fe78c3056c, user_id=134807c9df7845c0a94a8e831011f8d0, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:25.208309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad85e7-8889-4dc6-85d9-74156fa4facb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:25.238745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 879/1764] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:25 2022] PUT /identity/v3/projects/e66aec437bf04ce7a98336fe78c3056c/users/134807c9df7845c0a94a8e831011f8d0/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:25.239730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad85e7-8889-4dc6-85d9-74156fa4facb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:25.356532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092896e-4c42-4d2e-a42e-acabb9775588 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:25.464964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad85e7-8889-4dc6-85d9-74156fa4facb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:25.483142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92116121-f18d-4e74-a01b-046d8e8958cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:25.485651 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116121-f18d-4e74-a01b-046d8e8958cc admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:25.485963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116121-f18d-4e74-a01b-046d8e8958cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:25.486244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116121-f18d-4e74-a01b-046d8e8958cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:25.490328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92116121-f18d-4e74-a01b-046d8e8958cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:25.492056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92116121-f18d-4e74-a01b-046d8e8958cc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:25.540486 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 880/1765] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:25.543739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156dca-9074-497d-b582-f15be524e757 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:25.556774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156dca-9074-497d-b582-f15be524e757 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:25.556774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156dca-9074-497d-b582-f15be524e757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:25.568029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:25.581435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c34063-dc77-4fea-93ae-44538680bc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:25.582150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c34063-dc77-4fea-93ae-44538680bc4b service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:25.582437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c34063-dc77-4fea-93ae-44538680bc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:25.582743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c34063-dc77-4fea-93ae-44538680bc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:25.608907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c34063-dc77-4fea-93ae-44538680bc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:25.611034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c1156dca-9074-497d-b582-f15be524e757 None None] MFA Rules not processed for user `134807c9df7845c0a94a8e831011f8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:25.612602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c1156dca-9074-497d-b582-f15be524e757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:25.619914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c34063-dc77-4fea-93ae-44538680bc4b service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:25.651510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 886/1766] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:25.653671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c34063-dc77-4fea-93ae-44538680bc4b service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:25.708066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c34063-dc77-4fea-93ae-44538680bc4b service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:25.730664 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181956a4-7b91-4f0e-81e9-8ddf85f051fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:25.732857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181956a4-7b91-4f0e-81e9-8ddf85f051fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:25.734512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181956a4-7b91-4f0e-81e9-8ddf85f051fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:25.736190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181956a4-7b91-4f0e-81e9-8ddf85f051fc admin admin] PATH_INFO: `/v3/projects/3625eead7fa24e4b898a585d3b112cf3/users/bb821abdf2b74ffc8e061af90b5e8cd8/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:25.812993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181956a4-7b91-4f0e-81e9-8ddf85f051fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3625eead7fa24e4b898a585d3b112cf3, user_id=bb821abdf2b74ffc8e061af90b5e8cd8, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:25.820305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181956a4-7b91-4f0e-81e9-8ddf85f051fc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:25.827287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 881/1767] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:25.827287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1156dca-9074-497d-b582-f15be524e757 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:25.849819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c1156dca-9074-497d-b582-f15be524e757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:25.857205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 887/1768] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:25 2022] PUT /identity/v3/projects/3625eead7fa24e4b898a585d3b112cf3/users/bb821abdf2b74ffc8e061af90b5e8cd8/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:25.858234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181956a4-7b91-4f0e-81e9-8ddf85f051fc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:25.879488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1156dca-9074-497d-b582-f15be524e757 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:25.956580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:26.045192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:26.047399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:26.047603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:26.047803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] PATH_INFO: `/v3/projects/e0b86449db504d0598f29e9c5667e73f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:26.050291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b86449db504d0598f29e9c5667e73f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:26.056669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:26.118762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181956a4-7b91-4f0e-81e9-8ddf85f051fc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:26.138119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0e0f-db45-462f-b43a-ada89f26b216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:26.139017 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0e0f-db45-462f-b43a-ada89f26b216 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:26.140222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0e0f-db45-462f-b43a-ada89f26b216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:26.145185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0e0f-db45-462f-b43a-ada89f26b216 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:26.146130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec0e0f-db45-462f-b43a-ada89f26b216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:26.148875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec0e0f-db45-462f-b43a-ada89f26b216 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:26.192309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b86449db504d0598f29e9c5667e73f', 'request_id': 'req-7a940946-c90f-4388-9ceb-318b25f28867'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:26.208324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 888/1769] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:25 2022] POST /identity/v3/projects => generated 369 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:26.209445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0e0f-db45-462f-b43a-ada89f26b216 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:26.215000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b86449db504d0598f29e9c5667e73f', 'request_id': 'req-7a940946-c90f-4388-9ceb-318b25f28867'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:26.232974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b86449db504d0598f29e9c5667e73f', 'request_id': 'req-7a940946-c90f-4388-9ceb-318b25f28867'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:26.276690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] The token cache is being invalidate because project e0b86449db504d0598f29e9c5667e73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:26.277232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:26.278119 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:26.279814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 882/1770] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:25 2022] DELETE /identity/v3/projects/e0b86449db504d0598f29e9c5667e73f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:26.281453 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:26.284866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:26.487753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a940946-c90f-4388-9ceb-318b25f28867 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:26.515369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0e0f-db45-462f-b43a-ada89f26b216 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:26.529619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edbef4-5ba0-4ad7-a392-2612ed1c9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:26.530362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edbef4-5ba0-4ad7-a392-2612ed1c9b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:26.530682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edbef4-5ba0-4ad7-a392-2612ed1c9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:26.530966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edbef4-5ba0-4ad7-a392-2612ed1c9b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:26.531637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edbef4-5ba0-4ad7-a392-2612ed1c9b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:26.533569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edbef4-5ba0-4ad7-a392-2612ed1c9b82 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:26.559594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 889/1771] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:26.560353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edbef4-5ba0-4ad7-a392-2612ed1c9b82 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:26.574400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-56edbef4-5ba0-4ad7-a392-2612ed1c9b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:26.614681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edbef4-5ba0-4ad7-a392-2612ed1c9b82 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:26.646091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe74ac-8419-43d9-83e0-91393b81ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:26.646745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe74ac-8419-43d9-83e0-91393b81ae59 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:26.647028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe74ac-8419-43d9-83e0-91393b81ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:26.647308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe74ac-8419-43d9-83e0-91393b81ae59 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:26.647953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe74ac-8419-43d9-83e0-91393b81ae59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:26.650202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe74ac-8419-43d9-83e0-91393b81ae59 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:26.710942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 890/1772] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:26 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:26.715263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290969c4-8342-4593-ac20-1390bf238c05 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:26.715587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290969c4-8342-4593-ac20-1390bf238c05 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:26.715909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290969c4-8342-4593-ac20-1390bf238c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:26.725145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:26.726075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:26.728690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:26.729322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] PATH_INFO: `/v3/projects/f02fbc602bc74ffa82b1e6b36c28a9b0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:26.731292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02fbc602bc74ffa82b1e6b36c28a9b0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:26.737085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:26.743608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:26.778116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-290969c4-8342-4593-ac20-1390bf238c05 None None] MFA Rules not processed for user `7b1fde904acd460899d8c736f5762056`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:26.779377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-290969c4-8342-4593-ac20-1390bf238c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:26.837846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:26.929557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 891/1773] 10.222.0.85 () {58 vars in 1015 bytes} [Thu Aug 18 17:04:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:26.930969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290969c4-8342-4593-ac20-1390bf238c05 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:26.933928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-290969c4-8342-4593-ac20-1390bf238c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:26.941289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02fbc602bc74ffa82b1e6b36c28a9b0', 'request_id': 'req-ba186d09-5ea1-4611-8f57-851677d41fdd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:26.977167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290969c4-8342-4593-ac20-1390bf238c05 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:26.977331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02fbc602bc74ffa82b1e6b36c28a9b0', 'request_id': 'req-ba186d09-5ea1-4611-8f57-851677d41fdd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.008897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02fbc602bc74ffa82b1e6b36c28a9b0', 'request_id': 'req-ba186d09-5ea1-4611-8f57-851677d41fdd'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.043708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] The token cache is being invalidate because project f02fbc602bc74ffa82b1e6b36c28a9b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:27.043708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.049122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.052994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 883/1774] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:26 2022] DELETE /identity/v3/projects/f02fbc602bc74ffa82b1e6b36c28a9b0 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:27.054023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:27.055998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:27.167302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:27.168090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:27.168381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:27.168772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] PATH_INFO: `/v3/users/e8962468bfab49498f14ba218f662896` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:27.170237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8962468bfab49498f14ba218f662896)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:27.173956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:27.283231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba186d09-5ea1-4611-8f57-851677d41fdd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:27.297182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7b46-94c9-4208-9274-5b8fbbb3e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:27.297881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7b46-94c9-4208-9274-5b8fbbb3e7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:27.298162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7b46-94c9-4208-9274-5b8fbbb3e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:27.298434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7b46-94c9-4208-9274-5b8fbbb3e7c4 admin admin] PATH_INFO: `/v3/projects/3625eead7fa24e4b898a585d3b112cf3/users/bb821abdf2b74ffc8e061af90b5e8cd8/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:27.308574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff7b46-94c9-4208-9274-5b8fbbb3e7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3625eead7fa24e4b898a585d3b112cf3, user_id=bb821abdf2b74ffc8e061af90b5e8cd8, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:27.312308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff7b46-94c9-4208-9274-5b8fbbb3e7c4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:27.316271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8962468bfab49498f14ba218f662896'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.319130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8962468bfab49498f14ba218f662896'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.359260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 884/1775] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:27 2022] PUT /identity/v3/projects/3625eead7fa24e4b898a585d3b112cf3/users/bb821abdf2b74ffc8e061af90b5e8cd8/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:27.359260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7b46-94c9-4208-9274-5b8fbbb3e7c4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:27.359926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8962468bfab49498f14ba218f662896'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.362381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-49ff7b46-94c9-4208-9274-5b8fbbb3e7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:27.364236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8962468bfab49498f14ba218f662896'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.365408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8962468bfab49498f14ba218f662896'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.388182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 892/1776] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:26 2022] DELETE /identity/v3/users/e8962468bfab49498f14ba218f662896 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:27.390070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:27.391954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:27.649780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7b46-94c9-4208-9274-5b8fbbb3e7c4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:27.730401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abe577-0d8b-4f73-8c6e-87752e77ff6b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:27.748302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:27.749149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:27.749609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:27.749971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] PATH_INFO: `/v3/users/42993186b2c94409b131b57401647750` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:27.752702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42993186b2c94409b131b57401647750)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:27.755889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:27.762118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:27.814180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:27.903299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e202-43c8-488a-842d-f58e92122e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:27.903945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e202-43c8-488a-842d-f58e92122e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:27.904275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e202-43c8-488a-842d-f58e92122e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:27.904563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805e202-43c8-488a-842d-f58e92122e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:27.905373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e202-43c8-488a-842d-f58e92122e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:27.906751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42993186b2c94409b131b57401647750'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.909347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42993186b2c94409b131b57401647750'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.911495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805e202-43c8-488a-842d-f58e92122e5f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:27.948159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 885/1777] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 597 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:27.949100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e202-43c8-488a-842d-f58e92122e5f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:27.955510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f805e202-43c8-488a-842d-f58e92122e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:27.957599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42993186b2c94409b131b57401647750'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.986190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42993186b2c94409b131b57401647750'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:27.988031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ea70647d-4feb-434b-9a46-731df84d4608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42993186b2c94409b131b57401647750'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:28.031079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 893/1778] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:27 2022] DELETE /identity/v3/users/42993186b2c94409b131b57401647750 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:28.049533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217dedc-f8fb-4479-804d-eaabae4ede40 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:28.049888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217dedc-f8fb-4479-804d-eaabae4ede40 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:28.050177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217dedc-f8fb-4479-804d-eaabae4ede40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:28.127740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805e202-43c8-488a-842d-f58e92122e5f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:28.162360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d217dedc-f8fb-4479-804d-eaabae4ede40 None None] MFA Rules not processed for user `bb821abdf2b74ffc8e061af90b5e8cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:28.164599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d217dedc-f8fb-4479-804d-eaabae4ede40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:28.279340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c435cb-f147-4347-ab66-926f2bb6ca7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:28.280600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c435cb-f147-4347-ab66-926f2bb6ca7c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:28.280897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c435cb-f147-4347-ab66-926f2bb6ca7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:28.284629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c435cb-f147-4347-ab66-926f2bb6ca7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:28.290223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f2c435cb-f147-4347-ab66-926f2bb6ca7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:28.335487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c435cb-f147-4347-ab66-926f2bb6ca7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:28.337893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c435cb-f147-4347-ab66-926f2bb6ca7c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:28.364381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 886/1779] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:28.366334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c435cb-f147-4347-ab66-926f2bb6ca7c service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:28.369267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f2c435cb-f147-4347-ab66-926f2bb6ca7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:28.421455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 894/1780] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:28.431049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217dedc-f8fb-4479-804d-eaabae4ede40 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:28.432931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d217dedc-f8fb-4479-804d-eaabae4ede40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:28.602433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c435cb-f147-4347-ab66-926f2bb6ca7c service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:28.610033 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880280d-0d99-4bf0-9725-cd5c75bddbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:28.610685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880280d-0d99-4bf0-9725-cd5c75bddbc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:28.610971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880280d-0d99-4bf0-9725-cd5c75bddbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:28.611247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880280d-0d99-4bf0-9725-cd5c75bddbc0 admin admin] PATH_INFO: `/v3/projects/a15a6632999344e08e67a09e561bba9e/users/708f9c4122d84a89914089482eb816b6/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:28.632221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217dedc-f8fb-4479-804d-eaabae4ede40 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:28.639231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880280d-0d99-4bf0-9725-cd5c75bddbc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15a6632999344e08e67a09e561bba9e, user_id=708f9c4122d84a89914089482eb816b6, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:28.643913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527045f-bcef-4898-b332-bcdadb31061a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:28.644894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527045f-bcef-4898-b332-bcdadb31061a service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:28.645366 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527045f-bcef-4898-b332-bcdadb31061a service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:28.645751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527045f-bcef-4898-b332-bcdadb31061a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:28.656190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880280d-0d99-4bf0-9725-cd5c75bddbc0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:28.663240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527045f-bcef-4898-b332-bcdadb31061a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:28.665999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527045f-bcef-4898-b332-bcdadb31061a service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:28.722080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 887/1781] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:28 2022] PUT /identity/v3/projects/a15a6632999344e08e67a09e561bba9e/users/708f9c4122d84a89914089482eb816b6/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:28.722080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880280d-0d99-4bf0-9725-cd5c75bddbc0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:28.726906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 895/1782] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:28.728193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527045f-bcef-4898-b332-bcdadb31061a service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:28.732596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f880280d-0d99-4bf0-9725-cd5c75bddbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:28.765106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527045f-bcef-4898-b332-bcdadb31061a service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:28.766270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:28.779785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:28.905261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880280d-0d99-4bf0-9725-cd5c75bddbc0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:28.921303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:28.922085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:28.922463 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:28.922790 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] PATH_INFO: `/v3/projects/17e6ac5f3ba044e796c2cecc61f4536f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:28.926483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e6ac5f3ba044e796c2cecc61f4536f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:28.928686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:28.933914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ca65e-5bf3-447f-9785-6d9f1dc3438b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:28.934745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca65e-5bf3-447f-9785-6d9f1dc3438b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:28.935102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca65e-5bf3-447f-9785-6d9f1dc3438b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:28.935390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca65e-5bf3-447f-9785-6d9f1dc3438b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:28.938212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ca65e-5bf3-447f-9785-6d9f1dc3438b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:28.941910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ca65e-5bf3-447f-9785-6d9f1dc3438b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:28.956174 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 896/1783] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:28.957192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ca65e-5bf3-447f-9785-6d9f1dc3438b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:29.055350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e6ac5f3ba044e796c2cecc61f4536f', 'request_id': 'req-8952d42a-1205-40af-9120-64851aeadc4a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:29.070347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e6ac5f3ba044e796c2cecc61f4536f', 'request_id': 'req-8952d42a-1205-40af-9120-64851aeadc4a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:29.091170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e6ac5f3ba044e796c2cecc61f4536f', 'request_id': 'req-8952d42a-1205-40af-9120-64851aeadc4a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:29.116829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] The token cache is being invalidate because project 17e6ac5f3ba044e796c2cecc61f4536f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:29.117800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:29.121198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:29.131268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 888/1784] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:28 2022] DELETE /identity/v3/projects/17e6ac5f3ba044e796c2cecc61f4536f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:29.131460 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ca65e-5bf3-447f-9785-6d9f1dc3438b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:29.131575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:29.133360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:29.317390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952d42a-1205-40af-9120-64851aeadc4a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:29.323610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0b1a0-1389-4c82-b126-301018451fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:29.324259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0b1a0-1389-4c82-b126-301018451fca service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:29.324569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0b1a0-1389-4c82-b126-301018451fca service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:29.324848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0b1a0-1389-4c82-b126-301018451fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:29.327376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c4a0b1a0-1389-4c82-b126-301018451fca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:29.340653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c0a10-9293-4b9a-a67a-c90cdc89769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:29.341712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c0a10-9293-4b9a-a67a-c90cdc89769a admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:29.342000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c0a10-9293-4b9a-a67a-c90cdc89769a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:29.342313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c0a10-9293-4b9a-a67a-c90cdc89769a admin admin] PATH_INFO: `/v3/projects/a15a6632999344e08e67a09e561bba9e/users/708f9c4122d84a89914089482eb816b6/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:29.347409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c0a10-9293-4b9a-a67a-c90cdc89769a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15a6632999344e08e67a09e561bba9e, user_id=708f9c4122d84a89914089482eb816b6, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:29.358463 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c0a10-9293-4b9a-a67a-c90cdc89769a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:29.398741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 889/1785] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:29 2022] PUT /identity/v3/projects/a15a6632999344e08e67a09e561bba9e/users/708f9c4122d84a89914089482eb816b6/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:29.400157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc9bb8-08a7-476b-b3f7-42f156d80164 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:29.400450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc9bb8-08a7-476b-b3f7-42f156d80164 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:29.400915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc9bb8-08a7-476b-b3f7-42f156d80164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:29.471311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-99bc9bb8-08a7-476b-b3f7-42f156d80164 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:29.473523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-99bc9bb8-08a7-476b-b3f7-42f156d80164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:29.531160 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0b1a0-1389-4c82-b126-301018451fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:29.532926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0b1a0-1389-4c82-b126-301018451fca service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:29.548572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:29.558730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 897/1786] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:29.560002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0b1a0-1389-4c82-b126-301018451fca service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:29.566893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c4a0b1a0-1389-4c82-b126-301018451fca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:29.598787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0b1a0-1389-4c82-b126-301018451fca service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:29.621654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 890/1787] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:29.625619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:29.631558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b434-bf45-4f5f-b65d-8e0764991c4b None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:29.632297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b434-bf45-4f5f-b65d-8e0764991c4b None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:29.632673 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b434-bf45-4f5f-b65d-8e0764991c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:29.739390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fe86b434-bf45-4f5f-b65d-8e0764991c4b None None] MFA Rules not processed for user `708f9c4122d84a89914089482eb816b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:29.739390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fe86b434-bf45-4f5f-b65d-8e0764991c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:29.836755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:29.838591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:29.838925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:29.840385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] PATH_INFO: `/v3/projects/ec27291c19c14f9d831297948a9cbff1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:29.844428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec27291c19c14f9d831297948a9cbff1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:29.848535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:30.029331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec27291c19c14f9d831297948a9cbff1', 'request_id': 'req-692026dd-08cd-4dfe-b604-e0562f9ce863'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:30.055734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec27291c19c14f9d831297948a9cbff1', 'request_id': 'req-692026dd-08cd-4dfe-b604-e0562f9ce863'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:30.062638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 891/1788] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:30.068752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f719ac-3f7a-4c07-ac33-0ad6313f5e19 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:30.069073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f719ac-3f7a-4c07-ac33-0ad6313f5e19 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:30.069330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f719ac-3f7a-4c07-ac33-0ad6313f5e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:30.083249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec27291c19c14f9d831297948a9cbff1', 'request_id': 'req-692026dd-08cd-4dfe-b604-e0562f9ce863'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:30.130072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] The token cache is being invalidate because project ec27291c19c14f9d831297948a9cbff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:30.131102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:30.133931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-692026dd-08cd-4dfe-b604-e0562f9ce863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:30.136445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 898/1789] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:29 2022] DELETE /identity/v3/projects/ec27291c19c14f9d831297948a9cbff1 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:30.146434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb9b5-b3c8-4bde-b295-7956776d6306 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:30.146761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb9b5-b3c8-4bde-b295-7956776d6306 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:30.147004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb9b5-b3c8-4bde-b295-7956776d6306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:30.149906 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-20f719ac-3f7a-4c07-ac33-0ad6313f5e19 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:30.150718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-20f719ac-3f7a-4c07-ac33-0ad6313f5e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:30.208328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7c5bb9b5-b3c8-4bde-b295-7956776d6306 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:30.209713 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7c5bb9b5-b3c8-4bde-b295-7956776d6306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:30.349428 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 892/1790] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:30.353888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f719ac-3f7a-4c07-ac33-0ad6313f5e19 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:30.378405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f719ac-3f7a-4c07-ac33-0ad6313f5e19 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:30.399562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cec080-da1c-48ff-adc3-d40ae5c3c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:30.400226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cec080-da1c-48ff-adc3-d40ae5c3c90d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:30.400533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cec080-da1c-48ff-adc3-d40ae5c3c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:30.400812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cec080-da1c-48ff-adc3-d40ae5c3c90d admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:30.401476 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cec080-da1c-48ff-adc3-d40ae5c3c90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:30.401815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cec080-da1c-48ff-adc3-d40ae5c3c90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:30.403537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cec080-da1c-48ff-adc3-d40ae5c3c90d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:30.407777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 899/1791] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:30.415579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdf3a6-0a6c-4400-82ec-381f5356eddb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:30.415905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdf3a6-0a6c-4400-82ec-381f5356eddb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:30.416150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdf3a6-0a6c-4400-82ec-381f5356eddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:30.457051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 893/1792] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:30.462697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1afdf3a6-0a6c-4400-82ec-381f5356eddb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:30.463517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cec080-da1c-48ff-adc3-d40ae5c3c90d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:30.464122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1afdf3a6-0a6c-4400-82ec-381f5356eddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:30.488879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 900/1793] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:30.503191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdf3a6-0a6c-4400-82ec-381f5356eddb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:30.522949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdf3a6-0a6c-4400-82ec-381f5356eddb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:30.528486 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cec080-da1c-48ff-adc3-d40ae5c3c90d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:30.534038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b95e1-d963-4165-9150-8bfb36368fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:30.534734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b95e1-d963-4165-9150-8bfb36368fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:30.535082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b95e1-d963-4165-9150-8bfb36368fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:30.535463 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b95e1-d963-4165-9150-8bfb36368fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:30.536033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b95e1-d963-4165-9150-8bfb36368fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:30.536341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b95e1-d963-4165-9150-8bfb36368fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:30.538222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b95e1-d963-4165-9150-8bfb36368fb2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:30.549712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e125-f440-4a78-846e-9c6a6c243273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:30.551346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e125-f440-4a78-846e-9c6a6c243273 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:30.551811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e125-f440-4a78-846e-9c6a6c243273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:30.552102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5e125-f440-4a78-846e-9c6a6c243273 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:30.554067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5e125-f440-4a78-846e-9c6a6c243273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:30.559593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5e125-f440-4a78-846e-9c6a6c243273 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:30.580038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 901/1794] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:30.584877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b95e1-d963-4165-9150-8bfb36368fb2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:30.644327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b95e1-d963-4165-9150-8bfb36368fb2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:30.674709 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 894/1795] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:30 2022] POST /identity/v3/projects => generated 403 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:30.679708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4637d-0583-49a8-bc16-574005d28475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:30.680602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4637d-0583-49a8-bc16-574005d28475 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:30.681047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4637d-0583-49a8-bc16-574005d28475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:30.681487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4637d-0583-49a8-bc16-574005d28475 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:30.682284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4637d-0583-49a8-bc16-574005d28475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:30.682717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e125-f440-4a78-846e-9c6a6c243273 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:30.689222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8ba5e125-f440-4a78-846e-9c6a6c243273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:30.689638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4637d-0583-49a8-bc16-574005d28475 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:30.784844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 902/1796] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:30 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:30.785804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4637d-0583-49a8-bc16-574005d28475 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:30.808955 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:30.831677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:30.907915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5e125-f440-4a78-846e-9c6a6c243273 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:30.937316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4637d-0583-49a8-bc16-574005d28475 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:30.962773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540e9cd-bdbe-426b-894e-d7fda64557c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:30.963464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e9cd-bdbe-426b-894e-d7fda64557c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:30.965818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e9cd-bdbe-426b-894e-d7fda64557c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:30.966112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e9cd-bdbe-426b-894e-d7fda64557c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:30.966845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540e9cd-bdbe-426b-894e-d7fda64557c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:30.978506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540e9cd-bdbe-426b-894e-d7fda64557c1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:31.028778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 903/1797] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:30 2022] POST /identity/v3/users => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:31.031832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540e9cd-bdbe-426b-894e-d7fda64557c1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:31.083004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540e9cd-bdbe-426b-894e-d7fda64557c1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:31.085532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b2729-ad88-4740-9427-9de8a640d9be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:31.086203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b2729-ad88-4740-9427-9de8a640d9be service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.086483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b2729-ad88-4740-9427-9de8a640d9be service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.086897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b2729-ad88-4740-9427-9de8a640d9be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:31.090411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b71b2729-ad88-4740-9427-9de8a640d9be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:31.098646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c2038-c9ab-4e52-962c-607646cde6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:31.099319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c2038-c9ab-4e52-962c-607646cde6fb admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.099581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c2038-c9ab-4e52-962c-607646cde6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.099832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c2038-c9ab-4e52-962c-607646cde6fb admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:31.100568 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c2038-c9ab-4e52-962c-607646cde6fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:31.107592 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c2038-c9ab-4e52-962c-607646cde6fb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:31.199993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 904/1798] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:31 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:31.200892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c2038-c9ab-4e52-962c-607646cde6fb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:31.242322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c2038-c9ab-4e52-962c-607646cde6fb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:31.261917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14908e-b964-4ed5-ab09-3d3124bcd88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:31.262453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14908e-b964-4ed5-ab09-3d3124bcd88e admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.262951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14908e-b964-4ed5-ab09-3d3124bcd88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.263171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14908e-b964-4ed5-ab09-3d3124bcd88e admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:31.263734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14908e-b964-4ed5-ab09-3d3124bcd88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:31.277661 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14908e-b964-4ed5-ab09-3d3124bcd88e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:31.293960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b2729-ad88-4740-9427-9de8a640d9be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:31.296989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b2729-ad88-4740-9427-9de8a640d9be service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:31.310391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 905/1799] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:31.311288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14908e-b964-4ed5-ab09-3d3124bcd88e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:31.328851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 895/1800] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:31.330152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b2729-ad88-4740-9427-9de8a640d9be service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:31.348694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14908e-b964-4ed5-ab09-3d3124bcd88e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:31.360505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b2729-ad88-4740-9427-9de8a640d9be service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:31.369251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e2494-4985-4859-8511-2a79a42bb341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:31.369924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e2494-4985-4859-8511-2a79a42bb341 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.370241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e2494-4985-4859-8511-2a79a42bb341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.370540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e2494-4985-4859-8511-2a79a42bb341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:31.371199 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e2494-4985-4859-8511-2a79a42bb341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:31.372836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e2494-4985-4859-8511-2a79a42bb341 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:31.377087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f0bc2-e177-4dfd-9606-f707596a3e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:31.379279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f0bc2-e177-4dfd-9606-f707596a3e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.380244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f0bc2-e177-4dfd-9606-f707596a3e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.380895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f0bc2-e177-4dfd-9606-f707596a3e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:31.383491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f0bc2-e177-4dfd-9606-f707596a3e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:31.388813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f0bc2-e177-4dfd-9606-f707596a3e9b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:31.406925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 896/1801] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:31.411686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f0bc2-e177-4dfd-9606-f707596a3e9b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:31.424269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f0bc2-e177-4dfd-9606-f707596a3e9b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:31.424854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 906/1802] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:31.431551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e2494-4985-4859-8511-2a79a42bb341 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:31.433926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17566d-4a03-4234-b07b-22fabedf8e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:31.438741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17566d-4a03-4234-b07b-22fabedf8e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.438741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17566d-4a03-4234-b07b-22fabedf8e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.438741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17566d-4a03-4234-b07b-22fabedf8e4c admin admin] PATH_INFO: `/v3/projects/8dd3f31d14fc4beead70e8385ffb7cc5/users/e91ddb150fbf490590d5705c6b0ab9f3/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:31.446918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e2494-4985-4859-8511-2a79a42bb341 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:31.461911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22b1c3-ec30-41be-844f-754f21f69d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:31.462571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22b1c3-ec30-41be-844f-754f21f69d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.462822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22b1c3-ec30-41be-844f-754f21f69d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.463096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22b1c3-ec30-41be-844f-754f21f69d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:31.464831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22b1c3-ec30-41be-844f-754f21f69d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:31.469635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22b1c3-ec30-41be-844f-754f21f69d4b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:31.491926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17566d-4a03-4234-b07b-22fabedf8e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd3f31d14fc4beead70e8385ffb7cc5, user_id=e91ddb150fbf490590d5705c6b0ab9f3, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:31.496046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17566d-4a03-4234-b07b-22fabedf8e4c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:31.504635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 907/1803] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:31.505869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22b1c3-ec30-41be-844f-754f21f69d4b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:31.512515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5e22b1c3-ec30-41be-844f-754f21f69d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:31.536696 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 897/1804] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:31 2022] PUT /identity/v3/projects/8dd3f31d14fc4beead70e8385ffb7cc5/users/e91ddb150fbf490590d5705c6b0ab9f3/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:31.538514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17566d-4a03-4234-b07b-22fabedf8e4c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:31.539472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22b1c3-ec30-41be-844f-754f21f69d4b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:31.670656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103fa17-de85-47e7-a127-a291cf4e5f19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:31.673869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103fa17-de85-47e7-a127-a291cf4e5f19 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.674023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103fa17-de85-47e7-a127-a291cf4e5f19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.674411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103fa17-de85-47e7-a127-a291cf4e5f19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:31.679711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a103fa17-de85-47e7-a127-a291cf4e5f19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:31.693626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:31.703334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17566d-4a03-4234-b07b-22fabedf8e4c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:31.714925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3363d-1244-4590-a384-bea2203b8fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:31.715627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3363d-1244-4590-a384-bea2203b8fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.715905 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3363d-1244-4590-a384-bea2203b8fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.716177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3363d-1244-4590-a384-bea2203b8fd8 admin admin] PATH_INFO: `/v3/projects/6eeabef353724a6f820d89f0e8a9c2ee/users/1dc7b099768e46fdb17d8ad53ff43654/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:31.767354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3363d-1244-4590-a384-bea2203b8fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eeabef353724a6f820d89f0e8a9c2ee, user_id=1dc7b099768e46fdb17d8ad53ff43654, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:31.780716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3363d-1244-4590-a384-bea2203b8fd8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:31.806190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 898/1805] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:31 2022] PUT /identity/v3/projects/6eeabef353724a6f820d89f0e8a9c2ee/users/1dc7b099768e46fdb17d8ad53ff43654/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:31.823589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80e82b-0e29-45b8-8cf2-3424760b8ac6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.823589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80e82b-0e29-45b8-8cf2-3424760b8ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.823589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80e82b-0e29-45b8-8cf2-3424760b8ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:31.873427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ec80e82b-0e29-45b8-8cf2-3424760b8ac6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:31.881055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ec80e82b-0e29-45b8-8cf2-3424760b8ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:31.926103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:31.933789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103fa17-de85-47e7-a127-a291cf4e5f19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:31.936993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103fa17-de85-47e7-a127-a291cf4e5f19 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:31.963930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 908/1806] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:31.975916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7e8a1-35b6-414f-b25f-5d035872b2ce None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:31.976325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7e8a1-35b6-414f-b25f-5d035872b2ce None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:31.976750 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7e8a1-35b6-414f-b25f-5d035872b2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:32.080279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6ad7e8a1-35b6-414f-b25f-5d035872b2ce None None] MFA Rules not processed for user `1dc7b099768e46fdb17d8ad53ff43654`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:32.081709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6ad7e8a1-35b6-414f-b25f-5d035872b2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:32.167420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 899/1807] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:32.218160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80e82b-0e29-45b8-8cf2-3424760b8ac6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:32.219398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ec80e82b-0e29-45b8-8cf2-3424760b8ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:32.307092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 909/1808] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:32.309909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7e8a1-35b6-414f-b25f-5d035872b2ce None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:32.355015 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7e8a1-35b6-414f-b25f-5d035872b2ce None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:32.403524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a6683-4c98-458f-b3d2-d19f08461b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:32.407712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6683-4c98-458f-b3d2-d19f08461b85 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:32.407712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6683-4c98-458f-b3d2-d19f08461b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:32.407920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6683-4c98-458f-b3d2-d19f08461b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:32.408518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a6683-4c98-458f-b3d2-d19f08461b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:32.415361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a6683-4c98-458f-b3d2-d19f08461b85 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:32.447835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80e82b-0e29-45b8-8cf2-3424760b8ac6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:32.464602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb213f7b-61bc-4b06-954b-427777a9ff4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:32.469101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb213f7b-61bc-4b06-954b-427777a9ff4e service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:32.469621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb213f7b-61bc-4b06-954b-427777a9ff4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:32.470043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb213f7b-61bc-4b06-954b-427777a9ff4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:32.490950 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 910/1809] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:32 2022] POST /identity/v3/projects => generated 363 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:32.492618 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69479c60-a361-438f-9200-13619eb67654 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:32.492944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69479c60-a361-438f-9200-13619eb67654 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:32.495359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69479c60-a361-438f-9200-13619eb67654 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:32.497811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 911/1810] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:04:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:04:32.500113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb213f7b-61bc-4b06-954b-427777a9ff4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:32.502354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb213f7b-61bc-4b06-954b-427777a9ff4e service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:32.503930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69479c60-a361-438f-9200-13619eb67654 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:32.535381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 900/1811] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:32.779340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69479c60-a361-438f-9200-13619eb67654 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:32.794423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41ab90-c2c5-4278-9510-d62b31ff6796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:32.797955 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41ab90-c2c5-4278-9510-d62b31ff6796 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:32.798805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41ab90-c2c5-4278-9510-d62b31ff6796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:32.799321 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41ab90-c2c5-4278-9510-d62b31ff6796 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:32.801595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41ab90-c2c5-4278-9510-d62b31ff6796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:32.804205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41ab90-c2c5-4278-9510-d62b31ff6796 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:32.859209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 912/1812] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:32 2022] POST /identity/v3/users => generated 288 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:32.863365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb213f7b-61bc-4b06-954b-427777a9ff4e service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:32.883083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb213f7b-61bc-4b06-954b-427777a9ff4e service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:32.917870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af9448-43e4-4339-9344-c369c3cc3950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:32.919249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9448-43e4-4339-9344-c369c3cc3950 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:32.919990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9448-43e4-4339-9344-c369c3cc3950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:32.920733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9448-43e4-4339-9344-c369c3cc3950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:32.921544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af9448-43e4-4339-9344-c369c3cc3950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:32.935550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af9448-43e4-4339-9344-c369c3cc3950 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:32.973415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41ab90-c2c5-4278-9510-d62b31ff6796 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:32.974105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 901/1813] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:32.991905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41ab90-c2c5-4278-9510-d62b31ff6796 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:33.013946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c2529-927c-4f9d-a839-fdc8643ddf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:33.015230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2529-927c-4f9d-a839-fdc8643ddf08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:33.015534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2529-927c-4f9d-a839-fdc8643ddf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:33.015876 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c2529-927c-4f9d-a839-fdc8643ddf08 admin admin] PATH_INFO: `/v3/projects/79db5dcc38594b65b495e0e4cb6aeb0f/users/3e087f3350564953861b966002cdc57a/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:33.066645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a9e8-05d1-47dd-8b63-62bad24415fa None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:33.067073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a9e8-05d1-47dd-8b63-62bad24415fa None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:33.067460 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a9e8-05d1-47dd-8b63-62bad24415fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:33.094599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c2529-927c-4f9d-a839-fdc8643ddf08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79db5dcc38594b65b495e0e4cb6aeb0f, user_id=3e087f3350564953861b966002cdc57a, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:33.108546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c2529-927c-4f9d-a839-fdc8643ddf08 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:33.147343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8f33a9e8-05d1-47dd-8b63-62bad24415fa None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:33.149112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 913/1814] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:32 2022] PUT /identity/v3/projects/79db5dcc38594b65b495e0e4cb6aeb0f/users/3e087f3350564953861b966002cdc57a/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:33.153051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c2529-927c-4f9d-a839-fdc8643ddf08 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:33.154295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8f33a9e8-05d1-47dd-8b63-62bad24415fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:33.250829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:33.371761 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 902/1815] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:04:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:33.390591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c2529-927c-4f9d-a839-fdc8643ddf08 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:33.410934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad6979-c7cf-4040-8175-da82ed070753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:33.413067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6979-c7cf-4040-8175-da82ed070753 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:33.413470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6979-c7cf-4040-8175-da82ed070753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:33.415388 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad6979-c7cf-4040-8175-da82ed070753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:33.416208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad6979-c7cf-4040-8175-da82ed070753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:33.422733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad6979-c7cf-4040-8175-da82ed070753 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:33.467498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 914/1816] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:33.468799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a9e8-05d1-47dd-8b63-62bad24415fa None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:33.481101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:33.487893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a9e8-05d1-47dd-8b63-62bad24415fa None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:33.504079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81be28-5b50-4372-b562-0eef007eac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:33.505440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81be28-5b50-4372-b562-0eef007eac73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:33.505876 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81be28-5b50-4372-b562-0eef007eac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:33.506309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81be28-5b50-4372-b562-0eef007eac73 admin admin] PATH_INFO: `/v3/projects/79db5dcc38594b65b495e0e4cb6aeb0f/users/3e087f3350564953861b966002cdc57a/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:33.518489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81be28-5b50-4372-b562-0eef007eac73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79db5dcc38594b65b495e0e4cb6aeb0f, user_id=3e087f3350564953861b966002cdc57a, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:33.521461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81be28-5b50-4372-b562-0eef007eac73 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:33.564011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 903/1817] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:33 2022] PUT /identity/v3/projects/79db5dcc38594b65b495e0e4cb6aeb0f/users/3e087f3350564953861b966002cdc57a/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:33.574803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31c6e5-7e00-4dea-8848-07127a91ec7e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:33.575091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31c6e5-7e00-4dea-8848-07127a91ec7e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:33.575375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31c6e5-7e00-4dea-8848-07127a91ec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:33.637462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1e31c6e5-7e00-4dea-8848-07127a91ec7e None None] MFA Rules not processed for user `3e087f3350564953861b966002cdc57a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:33.638883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1e31c6e5-7e00-4dea-8848-07127a91ec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:33.849602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81be28-5b50-4372-b562-0eef007eac73 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:33.852016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ad81be28-5b50-4372-b562-0eef007eac73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:33.858579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 915/1818] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:33.978815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31c6e5-7e00-4dea-8848-07127a91ec7e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:34.125802 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81be28-5b50-4372-b562-0eef007eac73 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:34.153304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c28e8-e279-41cf-af5d-1da43f3ad843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:34.155490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c28e8-e279-41cf-af5d-1da43f3ad843 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:34.155921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c28e8-e279-41cf-af5d-1da43f3ad843 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:34.156444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c28e8-e279-41cf-af5d-1da43f3ad843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:34.184025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c28e8-e279-41cf-af5d-1da43f3ad843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:34.189172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c28e8-e279-41cf-af5d-1da43f3ad843 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:34.194739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31c6e5-7e00-4dea-8848-07127a91ec7e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:34.208485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc7c2f-b98b-492e-99ed-cc33b22747c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:34.209541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc7c2f-b98b-492e-99ed-cc33b22747c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:34.226329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc7c2f-b98b-492e-99ed-cc33b22747c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:34.228318 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc7c2f-b98b-492e-99ed-cc33b22747c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:34.260776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 904/1819] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:34.272801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc7c2f-b98b-492e-99ed-cc33b22747c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:34.288173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc7c2f-b98b-492e-99ed-cc33b22747c7 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:34.331511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 916/1820] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:34.547724 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c28e8-e279-41cf-af5d-1da43f3ad843 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:34.565152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c28e8-e279-41cf-af5d-1da43f3ad843 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:34.581492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395abbd3-8faf-4c3a-aa79-8bf259a1ffbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:34.582459 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abbd3-8faf-4c3a-aa79-8bf259a1ffbd service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:34.583019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abbd3-8faf-4c3a-aa79-8bf259a1ffbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:34.584558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abbd3-8faf-4c3a-aa79-8bf259a1ffbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:34.862743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395abbd3-8faf-4c3a-aa79-8bf259a1ffbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:34.865227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395abbd3-8faf-4c3a-aa79-8bf259a1ffbd service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:34.893306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 905/1821] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:35.722079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc7c2f-b98b-492e-99ed-cc33b22747c7 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:35.724732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-73dc7c2f-b98b-492e-99ed-cc33b22747c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:35.884133 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:35.936198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc7c2f-b98b-492e-99ed-cc33b22747c7 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:35.960770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:35.962569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:35.964239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:35.964719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] PATH_INFO: `/v3/users/4c6e188de16b4442aed572c12035d493` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:35.970081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c6e188de16b4442aed572c12035d493)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:35.971645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:36.009140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db814d8-1c28-46cb-aa45-8aa316c79ddd None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:36.009694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db814d8-1c28-46cb-aa45-8aa316c79ddd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:36.009785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db814d8-1c28-46cb-aa45-8aa316c79ddd None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:36.011159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 906/1822] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 17:04:36.094759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdb1b5-e78c-4929-b7a1-f6d0564236f7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:36.095061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdb1b5-e78c-4929-b7a1-f6d0564236f7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:36.095575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdb1b5-e78c-4929-b7a1-f6d0564236f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:36.151772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c6e188de16b4442aed572c12035d493'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:36.153712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c6e188de16b4442aed572c12035d493'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:36.156989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-50cdb1b5-e78c-4929-b7a1-f6d0564236f7 None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:36.162242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-50cdb1b5-e78c-4929-b7a1-f6d0564236f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:36.181706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c6e188de16b4442aed572c12035d493'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:36.194999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 907/1823] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:04:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:36.196081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c6e188de16b4442aed572c12035d493'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:36.196937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c6e188de16b4442aed572c12035d493'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:36.221414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 917/1824] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:35 2022] DELETE /identity/v3/users/4c6e188de16b4442aed572c12035d493 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:36.226944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3103-d1fe-476f-a80e-a8a058ee2e40 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:36.227970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3103-d1fe-476f-a80e-a8a058ee2e40 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:36.230951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3103-d1fe-476f-a80e-a8a058ee2e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:36.284279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-261e3103-d1fe-476f-a80e-a8a058ee2e40 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:36.285621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-261e3103-d1fe-476f-a80e-a8a058ee2e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:36.411691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 908/1825] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:36.479155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:36.481303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:36.772492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13186353-ffb1-4f38-891a-d89a51fbdc69 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:36.785884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752eea2-f82f-402d-8d04-609432d44256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:36.787208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752eea2-f82f-402d-8d04-609432d44256 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:36.787726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752eea2-f82f-402d-8d04-609432d44256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:36.788177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752eea2-f82f-402d-8d04-609432d44256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:36.838070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752eea2-f82f-402d-8d04-609432d44256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:36.839027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e3103-d1fe-476f-a80e-a8a058ee2e40 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:36.839528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752eea2-f82f-402d-8d04-609432d44256 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:36.841092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-261e3103-d1fe-476f-a80e-a8a058ee2e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:36.859987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:36.874330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 918/1826] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:36.957083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e3103-d1fe-476f-a80e-a8a058ee2e40 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:36.969382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9850bb3-a2ec-451c-b543-30046d617e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:36.970619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9850bb3-a2ec-451c-b543-30046d617e99 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:36.971245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9850bb3-a2ec-451c-b543-30046d617e99 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:36.971771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9850bb3-a2ec-451c-b543-30046d617e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:36.985604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9850bb3-a2ec-451c-b543-30046d617e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:36.987531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9850bb3-a2ec-451c-b543-30046d617e99 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:37.001951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 909/1827] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:37.075336 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752eea2-f82f-402d-8d04-609432d44256 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:37.077333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9752eea2-f82f-402d-8d04-609432d44256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:37.118168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752eea2-f82f-402d-8d04-609432d44256 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:37.136224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:37.137087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:37.137657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:37.138052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] PATH_INFO: `/v3/users/134807c9df7845c0a94a8e831011f8d0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:37.141782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134807c9df7845c0a94a8e831011f8d0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:37.143969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:37.266985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134807c9df7845c0a94a8e831011f8d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:37.267982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134807c9df7845c0a94a8e831011f8d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:37.288864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134807c9df7845c0a94a8e831011f8d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:37.295022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:37.301647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134807c9df7845c0a94a8e831011f8d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:37.302776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a408c956-1580-4e83-ae2e-73d6c46f2687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134807c9df7845c0a94a8e831011f8d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:37.324790 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ab24-c9e1-49e0-95b8-6de3e995f750 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:37.326333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ab24-c9e1-49e0-95b8-6de3e995f750 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:37.327690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ab24-c9e1-49e0-95b8-6de3e995f750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:37.355808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 919/1828] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:37 2022] DELETE /identity/v3/users/134807c9df7845c0a94a8e831011f8d0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:37.358545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a5e46-b4ef-4127-b19a-7493f86af6c5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:37.359146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a5e46-b4ef-4127-b19a-7493f86af6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:37.359814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a5e46-b4ef-4127-b19a-7493f86af6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:37.428509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-53e6ab24-c9e1-49e0-95b8-6de3e995f750 None None] MFA Rules not processed for user `e91ddb150fbf490590d5705c6b0ab9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:37.429885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-53e6ab24-c9e1-49e0-95b8-6de3e995f750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:37.432050 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-547a5e46-b4ef-4127-b19a-7493f86af6c5 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:37.436497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-547a5e46-b4ef-4127-b19a-7493f86af6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:37.613922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 920/1829] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:37.620196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 910/1830] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:37 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:37.625291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a5e46-b4ef-4127-b19a-7493f86af6c5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:37.626765 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-547a5e46-b4ef-4127-b19a-7493f86af6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:37.647209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6ab24-c9e1-49e0-95b8-6de3e995f750 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:37.649288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-53e6ab24-c9e1-49e0-95b8-6de3e995f750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:37.666846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a5e46-b4ef-4127-b19a-7493f86af6c5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:37.702917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf686c3-7f99-4f80-8b8c-78738ffa50b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:37.703563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf686c3-7f99-4f80-8b8c-78738ffa50b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:37.703846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf686c3-7f99-4f80-8b8c-78738ffa50b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:37.704142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf686c3-7f99-4f80-8b8c-78738ffa50b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:37.704880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf686c3-7f99-4f80-8b8c-78738ffa50b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:37.706818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf686c3-7f99-4f80-8b8c-78738ffa50b2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:37.774359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6ab24-c9e1-49e0-95b8-6de3e995f750 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:37.783164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5532bf8-5f2a-4b90-b0f8-042525e074c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:37.784049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532bf8-5f2a-4b90-b0f8-042525e074c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:37.784423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532bf8-5f2a-4b90-b0f8-042525e074c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:37.784909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5532bf8-5f2a-4b90-b0f8-042525e074c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:37.802349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 921/1831] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:37 2022] POST /identity/v3/projects => generated 405 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:37.809520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf686c3-7f99-4f80-8b8c-78738ffa50b2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:37.829345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5532bf8-5f2a-4b90-b0f8-042525e074c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:37.832394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5532bf8-5f2a-4b90-b0f8-042525e074c9 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:37.862297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 911/1832] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:37.863657 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5532bf8-5f2a-4b90-b0f8-042525e074c9 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:37.867391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f5532bf8-5f2a-4b90-b0f8-042525e074c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:37.901564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5532bf8-5f2a-4b90-b0f8-042525e074c9 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:37.968652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:37.970727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf686c3-7f99-4f80-8b8c-78738ffa50b2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:37.979621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b1b5-06d6-42f0-82e3-5e61daa638e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:37.980944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b1b5-06d6-42f0-82e3-5e61daa638e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:37.981675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b1b5-06d6-42f0-82e3-5e61daa638e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:37.982088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376b1b5-06d6-42f0-82e3-5e61daa638e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:37.982869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376b1b5-06d6-42f0-82e3-5e61daa638e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:37.985885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376b1b5-06d6-42f0-82e3-5e61daa638e8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:38.015255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:38.016142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:38.016268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:38.016573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] PATH_INFO: `/v3/users/1dc7b099768e46fdb17d8ad53ff43654` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:38.018106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc7b099768e46fdb17d8ad53ff43654)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:38.018874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 922/1833] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:37 2022] POST /identity/v3/users => generated 309 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:38.023226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b1b5-06d6-42f0-82e3-5e61daa638e8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:38.023670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:38.052060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376b1b5-06d6-42f0-82e3-5e61daa638e8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:38.059897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64c6dc-cb54-4ea7-ae01-d8f4273360af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:38.061987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64c6dc-cb54-4ea7-ae01-d8f4273360af admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:38.062504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64c6dc-cb54-4ea7-ae01-d8f4273360af admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:38.063464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64c6dc-cb54-4ea7-ae01-d8f4273360af admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:38.064355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64c6dc-cb54-4ea7-ae01-d8f4273360af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:38.066282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64c6dc-cb54-4ea7-ae01-d8f4273360af admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:38.090638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 923/1834] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:04:38.095752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64c6dc-cb54-4ea7-ae01-d8f4273360af admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:38.101061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc7b099768e46fdb17d8ad53ff43654'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:38.114090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc7b099768e46fdb17d8ad53ff43654'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:38.115405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc7b099768e46fdb17d8ad53ff43654'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:38.116357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc7b099768e46fdb17d8ad53ff43654'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:38.119081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64c6dc-cb54-4ea7-ae01-d8f4273360af admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:38.129199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-150cdb78-47c4-4767-b22a-8b69460313aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc7b099768e46fdb17d8ad53ff43654'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:38.131046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae60d-a2ba-4e19-976d-a628d29a9050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:38.131675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae60d-a2ba-4e19-976d-a628d29a9050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:38.131966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae60d-a2ba-4e19-976d-a628d29a9050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:38.132250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae60d-a2ba-4e19-976d-a628d29a9050 admin admin] PATH_INFO: `/v3/projects/9a1c17eb6a87460c90d77df9992b7776/users/94718eae0b044fb69db792239f60dbbc/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:38.168272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae60d-a2ba-4e19-976d-a628d29a9050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1c17eb6a87460c90d77df9992b7776, user_id=94718eae0b044fb69db792239f60dbbc, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:38.171008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 912/1835] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:37 2022] DELETE /identity/v3/users/1dc7b099768e46fdb17d8ad53ff43654 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:38.171888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae60d-a2ba-4e19-976d-a628d29a9050 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:38.175611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d518cd3-0b14-4204-a81b-6a160448cc27 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:38.176224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d518cd3-0b14-4204-a81b-6a160448cc27 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:38.176925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d518cd3-0b14-4204-a81b-6a160448cc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:38.195258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 924/1836] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:38 2022] PUT /identity/v3/projects/9a1c17eb6a87460c90d77df9992b7776/users/94718eae0b044fb69db792239f60dbbc/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:38.196272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae60d-a2ba-4e19-976d-a628d29a9050 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:38.198252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-58cae60d-a2ba-4e19-976d-a628d29a9050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:38.201238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7d518cd3-0b14-4204-a81b-6a160448cc27 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:38.203226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7d518cd3-0b14-4204-a81b-6a160448cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:38.228907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:38.296934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae60d-a2ba-4e19-976d-a628d29a9050 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:38.303212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09368d6-738a-4e5d-9372-2933ad7417eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:38.303902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09368d6-738a-4e5d-9372-2933ad7417eb admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:38.304225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09368d6-738a-4e5d-9372-2933ad7417eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:38.304545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09368d6-738a-4e5d-9372-2933ad7417eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:38.305262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09368d6-738a-4e5d-9372-2933ad7417eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:38.308002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09368d6-738a-4e5d-9372-2933ad7417eb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:38.340255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 925/1837] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:04:38.342119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09368d6-738a-4e5d-9372-2933ad7417eb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:38.361466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 913/1838] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:38.363833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09368d6-738a-4e5d-9372-2933ad7417eb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:38.368759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df9a09-52f7-4a89-8cd7-1ea7e783f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:38.369441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df9a09-52f7-4a89-8cd7-1ea7e783f9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:38.369725 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df9a09-52f7-4a89-8cd7-1ea7e783f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:38.370009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df9a09-52f7-4a89-8cd7-1ea7e783f9bc admin admin] PATH_INFO: `/v3/projects/9a1c17eb6a87460c90d77df9992b7776/users/94718eae0b044fb69db792239f60dbbc/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:38.372195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df9a09-52f7-4a89-8cd7-1ea7e783f9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1c17eb6a87460c90d77df9992b7776, user_id=94718eae0b044fb69db792239f60dbbc, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:38.375475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df9a09-52f7-4a89-8cd7-1ea7e783f9bc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:38.391705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 926/1839] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:38 2022] PUT /identity/v3/projects/9a1c17eb6a87460c90d77df9992b7776/users/94718eae0b044fb69db792239f60dbbc/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:38.400900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d518cd3-0b14-4204-a81b-6a160448cc27 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:38.402604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7d518cd3-0b14-4204-a81b-6a160448cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:38.474695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:38.483391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d518cd3-0b14-4204-a81b-6a160448cc27 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:38.561935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115356e8-3df0-4946-9aa2-fbbe268b1dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:38.562787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115356e8-3df0-4946-9aa2-fbbe268b1dab service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:38.563512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115356e8-3df0-4946-9aa2-fbbe268b1dab service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:38.564370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115356e8-3df0-4946-9aa2-fbbe268b1dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:38.635367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df9a09-52f7-4a89-8cd7-1ea7e783f9bc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:38.637849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f7df9a09-52f7-4a89-8cd7-1ea7e783f9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:38.710824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115356e8-3df0-4946-9aa2-fbbe268b1dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:38.712348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115356e8-3df0-4946-9aa2-fbbe268b1dab service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:38.757460 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 914/1840] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:38.797220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df9a09-52f7-4a89-8cd7-1ea7e783f9bc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:38.805127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:38.807616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:38.808059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:38.808490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] PATH_INFO: `/v3/projects/cc7cc6bf93ac49fe85720032b627cb7f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:38.810137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc7cc6bf93ac49fe85720032b627cb7f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:38.814021 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:38.878454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7cc6bf93ac49fe85720032b627cb7f', 'request_id': 'req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:38.890854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7cc6bf93ac49fe85720032b627cb7f', 'request_id': 'req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:38.905367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7cc6bf93ac49fe85720032b627cb7f', 'request_id': 'req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:38.920828 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] The token cache is being invalidate because project cc7cc6bf93ac49fe85720032b627cb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:38.921312 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:38.922052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:38.923908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 927/1841] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:38 2022] DELETE /identity/v3/projects/cc7cc6bf93ac49fe85720032b627cb7f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:38.927802 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115356e8-3df0-4946-9aa2-fbbe268b1dab service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:38.937927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115356e8-3df0-4946-9aa2-fbbe268b1dab service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:39.003809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:39.004603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:39.004885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:39.005160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] PATH_INFO: `/v3/users/bb821abdf2b74ffc8e061af90b5e8cd8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:39.006301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb821abdf2b74ffc8e061af90b5e8cd8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:39.008220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:39.018361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:39.019955 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:39.036610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ebdc5-c2d0-4db9-a9cc-b7c936b81b65 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:39.049214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:39.056524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:39.056960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:39.057246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] PATH_INFO: `/v3/projects/e66aec437bf04ce7a98336fe78c3056c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:39.059148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66aec437bf04ce7a98336fe78c3056c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:39.061934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:39.071015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb821abdf2b74ffc8e061af90b5e8cd8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.083420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb821abdf2b74ffc8e061af90b5e8cd8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.084920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb821abdf2b74ffc8e061af90b5e8cd8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.085825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb821abdf2b74ffc8e061af90b5e8cd8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.087556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:39.103298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb821abdf2b74ffc8e061af90b5e8cd8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.109196 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:39.132517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 915/1842] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:38 2022] DELETE /identity/v3/users/bb821abdf2b74ffc8e061af90b5e8cd8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:39.135681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66aec437bf04ce7a98336fe78c3056c', 'request_id': 'req-a897d46a-ded2-475b-90d1-67b9f6675922'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.146127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66aec437bf04ce7a98336fe78c3056c', 'request_id': 'req-a897d46a-ded2-475b-90d1-67b9f6675922'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.153697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66aec437bf04ce7a98336fe78c3056c', 'request_id': 'req-a897d46a-ded2-475b-90d1-67b9f6675922'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.165270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] The token cache is being invalidate because project e66aec437bf04ce7a98336fe78c3056c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:39.165636 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.166518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.168503 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 928/1843] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:39 2022] DELETE /identity/v3/projects/e66aec437bf04ce7a98336fe78c3056c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:39.173102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:39.174817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:39.263334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a7a6f-6c82-4b54-9da4-a6c904c5d946 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:39.270660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:39.272049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:39.272553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:39.273100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] PATH_INFO: `/v3/users/708f9c4122d84a89914089482eb816b6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:39.275783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=708f9c4122d84a89914089482eb816b6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:39.278150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:39.360750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708f9c4122d84a89914089482eb816b6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.370425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:39.373143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:39.375723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708f9c4122d84a89914089482eb816b6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.377810 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708f9c4122d84a89914089482eb816b6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.378896 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708f9c4122d84a89914089482eb816b6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.394188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708f9c4122d84a89914089482eb816b6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.424764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 916/1844] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:39 2022] DELETE /identity/v3/users/708f9c4122d84a89914089482eb816b6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:39.479108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d46a-ded2-475b-90d1-67b9f6675922 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:39.552888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:39.553551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:39.553869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:39.554203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] PATH_INFO: `/v3/projects/6eeabef353724a6f820d89f0e8a9c2ee` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:39.555417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eeabef353724a6f820d89f0e8a9c2ee)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:39.557498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:39.637840 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eeabef353724a6f820d89f0e8a9c2ee', 'request_id': 'req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.649767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eeabef353724a6f820d89f0e8a9c2ee', 'request_id': 'req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.659692 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eeabef353724a6f820d89f0e8a9c2ee', 'request_id': 'req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.669462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:39.677300 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] The token cache is being invalidate because project 6eeabef353724a6f820d89f0e8a9c2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:39.677978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.680120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a8547b4b-dc2d-4a4b-bc0c-e9adfd206c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.684706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 929/1845] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:39 2022] DELETE /identity/v3/projects/6eeabef353724a6f820d89f0e8a9c2ee => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:39.687033 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:39.688510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:39.703874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aeb0c-88e4-4aaf-a118-d7053b37d347 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:39.791980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:39.808265 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:39.809523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:39.810277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:39.812437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] PATH_INFO: `/v3/users/3e087f3350564953861b966002cdc57a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:39.814664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e087f3350564953861b966002cdc57a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:39.816846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:39.916819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e087f3350564953861b966002cdc57a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.941730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e087f3350564953861b966002cdc57a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.942506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e087f3350564953861b966002cdc57a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.945712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e087f3350564953861b966002cdc57a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.962469 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e087f3350564953861b966002cdc57a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:39.994136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0e8c-8c00-4755-b37c-f25d0532671c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:39.994958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0e8c-8c00-4755-b37c-f25d0532671c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:39.995534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0e8c-8c00-4755-b37c-f25d0532671c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:40.009700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 917/1846] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:39 2022] DELETE /identity/v3/users/3e087f3350564953861b966002cdc57a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:40.055284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0a9f0e8c-8c00-4755-b37c-f25d0532671c None None] MFA Rules not processed for user `94718eae0b044fb69db792239f60dbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:40.057804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0a9f0e8c-8c00-4755-b37c-f25d0532671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:40.214655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 930/1847] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:39 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:40.421461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:40.423296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:40.485391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f0e8c-8c00-4755-b37c-f25d0532671c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:40.487453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0a9f0e8c-8c00-4755-b37c-f25d0532671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:40.541596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502751e-9cac-4efd-a2c0-9ca971766401 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:40.548485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:40.549230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:40.549463 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:40.549741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] PATH_INFO: `/v3/projects/3625eead7fa24e4b898a585d3b112cf3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:40.551002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3625eead7fa24e4b898a585d3b112cf3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:40.553324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:40.597528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f0e8c-8c00-4755-b37c-f25d0532671c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:40.624931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3625eead7fa24e4b898a585d3b112cf3', 'request_id': 'req-03d3607e-62b9-41a1-9a45-d8b94cf6204e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.635212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3625eead7fa24e4b898a585d3b112cf3', 'request_id': 'req-03d3607e-62b9-41a1-9a45-d8b94cf6204e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.644797 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3625eead7fa24e4b898a585d3b112cf3', 'request_id': 'req-03d3607e-62b9-41a1-9a45-d8b94cf6204e'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.656219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:40.661256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] The token cache is being invalidate because project 3625eead7fa24e4b898a585d3b112cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:40.662080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.663171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-03d3607e-62b9-41a1-9a45-d8b94cf6204e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.666172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 918/1848] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:40 2022] DELETE /identity/v3/projects/3625eead7fa24e4b898a585d3b112cf3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:40.679606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d74ca6-3197-4bff-a226-3bf48cb96948 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:40.680178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d74ca6-3197-4bff-a226-3bf48cb96948 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:40.680483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d74ca6-3197-4bff-a226-3bf48cb96948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:40.691416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:40.693178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:40.693470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:40.693754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] PATH_INFO: `/v3/projects/a15a6632999344e08e67a09e561bba9e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:40.695342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15a6632999344e08e67a09e561bba9e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:40.700493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:40.705804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-33d74ca6-3197-4bff-a226-3bf48cb96948 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:40.707292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-33d74ca6-3197-4bff-a226-3bf48cb96948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:40.723772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 919/1849] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:40.734838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b55b-7ea5-4ede-9a21-7d9823e77ba7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:40.735583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b55b-7ea5-4ede-9a21-7d9823e77ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:40.736274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b55b-7ea5-4ede-9a21-7d9823e77ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:40.773638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bcd5b55b-7ea5-4ede-9a21-7d9823e77ba7 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:40.774569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:40.777407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bcd5b55b-7ea5-4ede-9a21-7d9823e77ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:40.801390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15a6632999344e08e67a09e561bba9e', 'request_id': 'req-816ee534-869e-48c5-bc83-694712102ae2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.826104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15a6632999344e08e67a09e561bba9e', 'request_id': 'req-816ee534-869e-48c5-bc83-694712102ae2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.839913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15a6632999344e08e67a09e561bba9e', 'request_id': 'req-816ee534-869e-48c5-bc83-694712102ae2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.867144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 920/1850] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:40.868323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5b55b-7ea5-4ede-9a21-7d9823e77ba7 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:40.870704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] The token cache is being invalidate because project a15a6632999344e08e67a09e561bba9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:40.870704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.871376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.871591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bcd5b55b-7ea5-4ede-9a21-7d9823e77ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:40.873751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 931/1851] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:40 2022] DELETE /identity/v3/projects/a15a6632999344e08e67a09e561bba9e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:40.874545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:40.875776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:40.888809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ee534-869e-48c5-bc83-694712102ae2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:40.889647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5b55b-7ea5-4ede-9a21-7d9823e77ba7 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:40.894389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:40.894703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3a57e-05e6-449c-9a43-6baa71d4c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:40.895031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:40.895320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3a57e-05e6-449c-9a43-6baa71d4c8ca admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:40.895490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:40.895621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3a57e-05e6-449c-9a43-6baa71d4c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:40.895876 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] PATH_INFO: `/v3/projects/79db5dcc38594b65b495e0e4cb6aeb0f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:40.895983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3a57e-05e6-449c-9a43-6baa71d4c8ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:40.896679 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3a57e-05e6-449c-9a43-6baa71d4c8ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:40.897056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=79db5dcc38594b65b495e0e4cb6aeb0f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:40.897161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3a57e-05e6-449c-9a43-6baa71d4c8ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:40.898708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3a57e-05e6-449c-9a43-6baa71d4c8ca admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:40.900642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:40.915083 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 932/1852] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:40.916679 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647372d6-d30c-41fb-a5b1-580b97828bd1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:40.917125 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647372d6-d30c-41fb-a5b1-580b97828bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:40.917406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647372d6-d30c-41fb-a5b1-580b97828bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:40.940207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-647372d6-d30c-41fb-a5b1-580b97828bd1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:40.941569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-647372d6-d30c-41fb-a5b1-580b97828bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:40.956112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 933/1853] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:40.957034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647372d6-d30c-41fb-a5b1-580b97828bd1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:40.960382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79db5dcc38594b65b495e0e4cb6aeb0f', 'request_id': 'req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.971011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79db5dcc38594b65b495e0e4cb6aeb0f', 'request_id': 'req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.971218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647372d6-d30c-41fb-a5b1-580b97828bd1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:40.984110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79db5dcc38594b65b495e0e4cb6aeb0f', 'request_id': 'req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.996959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] The token cache is being invalidate because project 79db5dcc38594b65b495e0e4cb6aeb0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:40.997570 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:40.998949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-caf83075-ef7c-4aa1-afb8-4b8f6339faaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:41.004130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 921/1854] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:40 2022] DELETE /identity/v3/projects/79db5dcc38594b65b495e0e4cb6aeb0f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:41.004130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68b68-c38a-412d-9534-70c7827879c2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.004130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68b68-c38a-412d-9534-70c7827879c2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.004130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68b68-c38a-412d-9534-70c7827879c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.022735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-01a68b68-c38a-412d-9534-70c7827879c2 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:41.024104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-01a68b68-c38a-412d-9534-70c7827879c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:41.049470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a935d1a-44e5-4c8d-aefb-7f2d76843048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.050193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935d1a-44e5-4c8d-aefb-7f2d76843048 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.050652 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935d1a-44e5-4c8d-aefb-7f2d76843048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.051023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a935d1a-44e5-4c8d-aefb-7f2d76843048 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.051719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a935d1a-44e5-4c8d-aefb-7f2d76843048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.054123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a935d1a-44e5-4c8d-aefb-7f2d76843048 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.094535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 934/1855] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:40 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:41.094535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463378-7dba-42b2-b2ce-d13f629e7ed5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.094535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463378-7dba-42b2-b2ce-d13f629e7ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.094535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6463378-7dba-42b2-b2ce-d13f629e7ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.114708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f6463378-7dba-42b2-b2ce-d13f629e7ed5 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:41.115947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f6463378-7dba-42b2-b2ce-d13f629e7ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:41.117492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 922/1856] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:41.118550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a68b68-c38a-412d-9534-70c7827879c2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.120189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-01a68b68-c38a-412d-9534-70c7827879c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:41.133342 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a68b68-c38a-412d-9534-70c7827879c2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.151028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:41.200020 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 935/1857] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:41.200717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6463378-7dba-42b2-b2ce-d13f629e7ed5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.207772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be225534-7b14-4798-ac3c-7d025aaf8870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.208429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225534-7b14-4798-ac3c-7d025aaf8870 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.208780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225534-7b14-4798-ac3c-7d025aaf8870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.209053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225534-7b14-4798-ac3c-7d025aaf8870 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.209736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be225534-7b14-4798-ac3c-7d025aaf8870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.212452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be225534-7b14-4798-ac3c-7d025aaf8870 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.215914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6463378-7dba-42b2-b2ce-d13f629e7ed5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.221609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17160164-116d-40ba-9977-96642cc08742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.222702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17160164-116d-40ba-9977-96642cc08742 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.223527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17160164-116d-40ba-9977-96642cc08742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.224153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17160164-116d-40ba-9977-96642cc08742 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.224883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17160164-116d-40ba-9977-96642cc08742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:41.225234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17160164-116d-40ba-9977-96642cc08742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.226988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17160164-116d-40ba-9977-96642cc08742 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.240858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 923/1858] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:41.242129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 936/1859] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:41.242850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4c6f-b6f9-44ce-847d-100a62cbf10d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.243333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4c6f-b6f9-44ce-847d-100a62cbf10d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.243453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1b65a-8254-44b2-81e2-36914bcb5922 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.243662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1b65a-8254-44b2-81e2-36914bcb5922 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.243945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1b65a-8254-44b2-81e2-36914bcb5922 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.244206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4c6f-b6f9-44ce-847d-100a62cbf10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.245429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 937/1860] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:04:41.246152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1b65a-8254-44b2-81e2-36914bcb5922 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.260004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1b65a-8254-44b2-81e2-36914bcb5922 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.264679 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6062dc0-c1d1-474b-94a5-e6ad6a4e553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.265301 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6062dc0-c1d1-474b-94a5-e6ad6a4e553b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.265583 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6062dc0-c1d1-474b-94a5-e6ad6a4e553b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.265944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6062dc0-c1d1-474b-94a5-e6ad6a4e553b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.266602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6062dc0-c1d1-474b-94a5-e6ad6a4e553b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.268203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6062dc0-c1d1-474b-94a5-e6ad6a4e553b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.268877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-173a4c6f-b6f9-44ce-847d-100a62cbf10d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:41.270494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-173a4c6f-b6f9-44ce-847d-100a62cbf10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:41.271924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:41.280163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 924/1861] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:41.284407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4c6f-b6f9-44ce-847d-100a62cbf10d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.293227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4c6f-b6f9-44ce-847d-100a62cbf10d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.293997 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 938/1862] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:41.296875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f895fa0-73b6-4999-bded-9d7fcb2bfdc1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.297325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f895fa0-73b6-4999-bded-9d7fcb2bfdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.297771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f895fa0-73b6-4999-bded-9d7fcb2bfdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.298102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7f5e9-859f-4f74-9a14-b421afcb3089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.298727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7f5e9-859f-4f74-9a14-b421afcb3089 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.299006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7f5e9-859f-4f74-9a14-b421afcb3089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.299718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7f5e9-859f-4f74-9a14-b421afcb3089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.299975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7f5e9-859f-4f74-9a14-b421afcb3089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.302002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7f5e9-859f-4f74-9a14-b421afcb3089 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.334181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 925/1863] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:41.335084 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7f5e9-859f-4f74-9a14-b421afcb3089 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.335497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9f895fa0-73b6-4999-bded-9d7fcb2bfdc1 None None] MFA Rules not processed for user `4cc1ad7e47454b5d9d2ef2190414010c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:41.336918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9f895fa0-73b6-4999-bded-9d7fcb2bfdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:41.438090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7f5e9-859f-4f74-9a14-b421afcb3089 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.443495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f6b53-18cf-45c5-87a8-9c849abe106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.444385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f6b53-18cf-45c5-87a8-9c849abe106b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.444581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 939/1864] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:41.444982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f6b53-18cf-45c5-87a8-9c849abe106b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.445923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f895fa0-73b6-4999-bded-9d7fcb2bfdc1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.446346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f6b53-18cf-45c5-87a8-9c849abe106b admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.447284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f6b53-18cf-45c5-87a8-9c849abe106b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:41.447822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f6b53-18cf-45c5-87a8-9c849abe106b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.449751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f6b53-18cf-45c5-87a8-9c849abe106b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.459718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f895fa0-73b6-4999-bded-9d7fcb2bfdc1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.466105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 926/1865] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:41.466727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adff7a1-9118-4202-90f1-2f9b53e64647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.467553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f6b53-18cf-45c5-87a8-9c849abe106b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.468522 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff7a1-9118-4202-90f1-2f9b53e64647 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.468793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff7a1-9118-4202-90f1-2f9b53e64647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.469082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff7a1-9118-4202-90f1-2f9b53e64647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.473211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adff7a1-9118-4202-90f1-2f9b53e64647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.475340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adff7a1-9118-4202-90f1-2f9b53e64647 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.479348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f6b53-18cf-45c5-87a8-9c849abe106b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.485525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15ee55-3c4b-4b59-840b-72a1a4d4433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.486315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15ee55-3c4b-4b59-840b-72a1a4d4433d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.486663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15ee55-3c4b-4b59-840b-72a1a4d4433d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.487020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15ee55-3c4b-4b59-840b-72a1a4d4433d admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.487727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15ee55-3c4b-4b59-840b-72a1a4d4433d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.490090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15ee55-3c4b-4b59-840b-72a1a4d4433d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.490611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 940/1866] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:41.491524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adff7a1-9118-4202-90f1-2f9b53e64647 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.493352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8adff7a1-9118-4202-90f1-2f9b53e64647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:41.511127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adff7a1-9118-4202-90f1-2f9b53e64647 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.517254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2984c47-77f1-47a1-ac1d-8ebb6bdde5aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.518006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2984c47-77f1-47a1-ac1d-8ebb6bdde5aa service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.518378 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2984c47-77f1-47a1-ac1d-8ebb6bdde5aa service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.518724 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2984c47-77f1-47a1-ac1d-8ebb6bdde5aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.528382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2984c47-77f1-47a1-ac1d-8ebb6bdde5aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.530911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2984c47-77f1-47a1-ac1d-8ebb6bdde5aa service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.531732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 927/1867] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/users => generated 291 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:41.532901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15ee55-3c4b-4b59-840b-72a1a4d4433d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.542567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 941/1868] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:41.543529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2984c47-77f1-47a1-ac1d-8ebb6bdde5aa service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.547682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15ee55-3c4b-4b59-840b-72a1a4d4433d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.555145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e18f1-6b60-47f8-b35a-b538187c1020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.555925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e18f1-6b60-47f8-b35a-b538187c1020 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.556224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e18f1-6b60-47f8-b35a-b538187c1020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.556523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e18f1-6b60-47f8-b35a-b538187c1020 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.557216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2984c47-77f1-47a1-ac1d-8ebb6bdde5aa service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.557364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e18f1-6b60-47f8-b35a-b538187c1020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.559320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e18f1-6b60-47f8-b35a-b538187c1020 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.572000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a7b3e-6a46-4d58-a25e-e61dc7999789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.574973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a7b3e-6a46-4d58-a25e-e61dc7999789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.574973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a7b3e-6a46-4d58-a25e-e61dc7999789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.574973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a7b3e-6a46-4d58-a25e-e61dc7999789 admin admin] PATH_INFO: `/v3/projects/bef467cdc3c043ba8bcfe4c5abeb3d64/users/efa878aa241846ea9491aead6595dce1/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.597928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a7b3e-6a46-4d58-a25e-e61dc7999789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef467cdc3c043ba8bcfe4c5abeb3d64, user_id=efa878aa241846ea9491aead6595dce1, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.602103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a7b3e-6a46-4d58-a25e-e61dc7999789 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.608534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 928/1869] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:41.611752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e18f1-6b60-47f8-b35a-b538187c1020 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.642911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 942/1870] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:41 2022] PUT /identity/v3/projects/bef467cdc3c043ba8bcfe4c5abeb3d64/users/efa878aa241846ea9491aead6595dce1/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:41.642911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a7b3e-6a46-4d58-a25e-e61dc7999789 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.682293 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:41.738107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e18f1-6b60-47f8-b35a-b538187c1020 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.765747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a7b3e-6a46-4d58-a25e-e61dc7999789 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.771672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847806a0-e7ee-4055-a146-7dbeeaef9ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.772347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847806a0-e7ee-4055-a146-7dbeeaef9ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.772667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847806a0-e7ee-4055-a146-7dbeeaef9ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.772944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847806a0-e7ee-4055-a146-7dbeeaef9ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.773580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847806a0-e7ee-4055-a146-7dbeeaef9ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.775541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847806a0-e7ee-4055-a146-7dbeeaef9ce3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.804616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 943/1871] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:41.806503 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775b14-351f-4502-8193-2f6e3f37a43c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.806949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775b14-351f-4502-8193-2f6e3f37a43c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.807439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775b14-351f-4502-8193-2f6e3f37a43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.844752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-87775b14-351f-4502-8193-2f6e3f37a43c None None] MFA Rules not processed for user `efa878aa241846ea9491aead6595dce1`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:41.845986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-87775b14-351f-4502-8193-2f6e3f37a43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:41.848668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d121fd-9928-4ffa-9037-aeb7e8af0c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.849785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d121fd-9928-4ffa-9037-aeb7e8af0c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.850280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d121fd-9928-4ffa-9037-aeb7e8af0c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.851001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d121fd-9928-4ffa-9037-aeb7e8af0c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.851763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d121fd-9928-4ffa-9037-aeb7e8af0c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.853797 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d121fd-9928-4ffa-9037-aeb7e8af0c20 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.869808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 929/1872] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:41.869808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d121fd-9928-4ffa-9037-aeb7e8af0c20 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.883279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d121fd-9928-4ffa-9037-aeb7e8af0c20 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.890840 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:41.894681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d3c12-2aae-4c4d-8d03-e2876905bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.895885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d3c12-2aae-4c4d-8d03-e2876905bd05 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.896245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d3c12-2aae-4c4d-8d03-e2876905bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.896712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d3c12-2aae-4c4d-8d03-e2876905bd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.897360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d3c12-2aae-4c4d-8d03-e2876905bd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.898953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d3c12-2aae-4c4d-8d03-e2876905bd05 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.915782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 930/1873] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:41.916923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d3c12-2aae-4c4d-8d03-e2876905bd05 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.929275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d3c12-2aae-4c4d-8d03-e2876905bd05 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.934067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a08bf-73d9-4f15-8875-912702ab38c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.934675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a08bf-73d9-4f15-8875-912702ab38c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.934964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a08bf-73d9-4f15-8875-912702ab38c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.935716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a08bf-73d9-4f15-8875-912702ab38c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.935913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a08bf-73d9-4f15-8875-912702ab38c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.937536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a08bf-73d9-4f15-8875-912702ab38c7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.938766 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 944/1874] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:41.941327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87775b14-351f-4502-8193-2f6e3f37a43c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.953067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87775b14-351f-4502-8193-2f6e3f37a43c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.953715 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 931/1875] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:41.954501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a08bf-73d9-4f15-8875-912702ab38c7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.958231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49c692-69f5-43bf-9bfa-84820f94b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.958818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c692-69f5-43bf-9bfa-84820f94b2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.959438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c692-69f5-43bf-9bfa-84820f94b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.959438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c692-69f5-43bf-9bfa-84820f94b2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.960134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49c692-69f5-43bf-9bfa-84820f94b2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.961801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49c692-69f5-43bf-9bfa-84820f94b2c5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.964781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a08bf-73d9-4f15-8875-912702ab38c7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.972288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b77677-f97e-45d9-87df-acad831df15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.973000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b77677-f97e-45d9-87df-acad831df15a admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.973370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b77677-f97e-45d9-87df-acad831df15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.973717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b77677-f97e-45d9-87df-acad831df15a admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:41.977162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 945/1876] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:41.977286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b77677-f97e-45d9-87df-acad831df15a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:41.977384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49c692-69f5-43bf-9bfa-84820f94b2c5 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:41.977466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b77677-f97e-45d9-87df-acad831df15a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:41.985706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49c692-69f5-43bf-9bfa-84820f94b2c5 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:41.990747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf138ba6-5923-473d-abaf-9dc920618846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:41.991401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf138ba6-5923-473d-abaf-9dc920618846 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:41.991697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf138ba6-5923-473d-abaf-9dc920618846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:41.991974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf138ba6-5923-473d-abaf-9dc920618846 admin admin] PATH_INFO: `/v3/projects/9affd09af02440e0843c47c41044e818/users/12d0dfcfe2384ccf84be2eb64fa071f3/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.005984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 932/1877] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:41 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:42.007086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b77677-f97e-45d9-87df-acad831df15a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.011329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf138ba6-5923-473d-abaf-9dc920618846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9affd09af02440e0843c47c41044e818, user_id=12d0dfcfe2384ccf84be2eb64fa071f3, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.014616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf138ba6-5923-473d-abaf-9dc920618846 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.031594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 946/1878] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:41 2022] PUT /identity/v3/projects/9affd09af02440e0843c47c41044e818/users/12d0dfcfe2384ccf84be2eb64fa071f3/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:42.032259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf138ba6-5923-473d-abaf-9dc920618846 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.082165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b77677-f97e-45d9-87df-acad831df15a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.124117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf138ba6-5923-473d-abaf-9dc920618846 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.127631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:42.129740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d511e08-09d4-4b72-a639-a973ec4bf0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.130471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511e08-09d4-4b72-a639-a973ec4bf0df admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.130827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511e08-09d4-4b72-a639-a973ec4bf0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.131173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d511e08-09d4-4b72-a639-a973ec4bf0df admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.131880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d511e08-09d4-4b72-a639-a973ec4bf0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.134043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d511e08-09d4-4b72-a639-a973ec4bf0df admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.152799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618036c-c3c0-4490-969c-609f0a74d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.153864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618036c-c3c0-4490-969c-609f0a74d377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.155215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618036c-c3c0-4490-969c-609f0a74d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.155646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618036c-c3c0-4490-969c-609f0a74d377 admin admin] PATH_INFO: `/v3/projects/95aa7b7ac35d46148cbc0df83b24160e/users/d60d90927dfd47e588618706c394c23a/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.164133 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 947/1879] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:42 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:42.166054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754d8a-ef10-4c9e-beb4-5aafe325522c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.166345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754d8a-ef10-4c9e-beb4-5aafe325522c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.167060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89754d8a-ef10-4c9e-beb4-5aafe325522c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.173526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618036c-c3c0-4490-969c-609f0a74d377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95aa7b7ac35d46148cbc0df83b24160e, user_id=d60d90927dfd47e588618706c394c23a, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.176638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618036c-c3c0-4490-969c-609f0a74d377 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.192205 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 933/1880] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:42 2022] PUT /identity/v3/projects/95aa7b7ac35d46148cbc0df83b24160e/users/d60d90927dfd47e588618706c394c23a/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:42.196786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618036c-c3c0-4490-969c-609f0a74d377 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.202021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1618036c-c3c0-4490-969c-609f0a74d377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:42.206439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-89754d8a-ef10-4c9e-beb4-5aafe325522c None None] MFA Rules not processed for user `12d0dfcfe2384ccf84be2eb64fa071f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:42.207659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-89754d8a-ef10-4c9e-beb4-5aafe325522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:42.285599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618036c-c3c0-4490-969c-609f0a74d377 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.288525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 948/1881] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:42.290630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.291274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.291557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.291833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] PATH_INFO: `/v3/users/e91ddb150fbf490590d5705c6b0ab9f3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.292984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91ddb150fbf490590d5705c6b0ab9f3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.293114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89754d8a-ef10-4c9e-beb4-5aafe325522c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.295055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.304367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89754d8a-ef10-4c9e-beb4-5aafe325522c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.309742 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5f429-2603-467b-ab86-c0fe37ff2034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.310547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5f429-2603-467b-ab86-c0fe37ff2034 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.310870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5f429-2603-467b-ab86-c0fe37ff2034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.311234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5f429-2603-467b-ab86-c0fe37ff2034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.312042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5f429-2603-467b-ab86-c0fe37ff2034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.314109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5f429-2603-467b-ab86-c0fe37ff2034 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.316487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:42.327931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 949/1882] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:42.332757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe761-0c1e-4c7c-89a5-8bff00c7ae37 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.333059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe761-0c1e-4c7c-89a5-8bff00c7ae37 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.333342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe761-0c1e-4c7c-89a5-8bff00c7ae37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.349055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91ddb150fbf490590d5705c6b0ab9f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:42.362953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91ddb150fbf490590d5705c6b0ab9f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:42.363678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91ddb150fbf490590d5705c6b0ab9f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:42.364441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91ddb150fbf490590d5705c6b0ab9f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:42.369272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6cffe761-0c1e-4c7c-89a5-8bff00c7ae37 None None] MFA Rules not processed for user `d60d90927dfd47e588618706c394c23a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:42.370599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6cffe761-0c1e-4c7c-89a5-8bff00c7ae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:42.374468 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91ddb150fbf490590d5705c6b0ab9f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:42.397615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 934/1883] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:42 2022] DELETE /identity/v3/users/e91ddb150fbf490590d5705c6b0ab9f3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:42.401367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.402790 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:42.458665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:42.466696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 950/1884] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:42.472361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffe761-0c1e-4c7c-89a5-8bff00c7ae37 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.474740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6cffe761-0c1e-4c7c-89a5-8bff00c7ae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:42.486767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c48f4-6ba8-4ced-89ca-5570a20fcf56 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.493221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be179ea-3cd3-43ee-a129-72297adbb3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.493877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be179ea-3cd3-43ee-a129-72297adbb3df admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.494158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be179ea-3cd3-43ee-a129-72297adbb3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.494436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be179ea-3cd3-43ee-a129-72297adbb3df admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.495076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be179ea-3cd3-43ee-a129-72297adbb3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.497051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be179ea-3cd3-43ee-a129-72297adbb3df admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.497950 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffe761-0c1e-4c7c-89a5-8bff00c7ae37 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.504321 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182157e-0181-455b-bc93-264a448e8377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.505382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182157e-0181-455b-bc93-264a448e8377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.505864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182157e-0181-455b-bc93-264a448e8377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.506360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182157e-0181-455b-bc93-264a448e8377 admin admin] PATH_INFO: `/v3/projects/a8009afbb7df445b9d33b598bc250824/users/7b91f308a3e74ba5a1aa37c33ef6ef7b/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.526024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182157e-0181-455b-bc93-264a448e8377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8009afbb7df445b9d33b598bc250824, user_id=7b91f308a3e74ba5a1aa37c33ef6ef7b, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.530366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 935/1885] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:42 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:42.531250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be179ea-3cd3-43ee-a129-72297adbb3df admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.532286 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182157e-0181-455b-bc93-264a448e8377 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.532914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0be179ea-3cd3-43ee-a129-72297adbb3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:42.558781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 951/1886] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:42 2022] PUT /identity/v3/projects/a8009afbb7df445b9d33b598bc250824/users/7b91f308a3e74ba5a1aa37c33ef6ef7b/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:42.559839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182157e-0181-455b-bc93-264a448e8377 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.620874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be179ea-3cd3-43ee-a129-72297adbb3df admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.646550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182157e-0181-455b-bc93-264a448e8377 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.656702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db4e6-51e4-4300-850f-b4b42bbc494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.657512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db4e6-51e4-4300-850f-b4b42bbc494b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.657949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db4e6-51e4-4300-850f-b4b42bbc494b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.658525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db4e6-51e4-4300-850f-b4b42bbc494b admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.659192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422db4e6-51e4-4300-850f-b4b42bbc494b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.661166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422db4e6-51e4-4300-850f-b4b42bbc494b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.683530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 952/1887] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:42 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:42.684352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db4e6-51e4-4300-850f-b4b42bbc494b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.691153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad94e8b-01dc-482e-8f76-f10777b20b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.691865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad94e8b-01dc-482e-8f76-f10777b20b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.692228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad94e8b-01dc-482e-8f76-f10777b20b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.692630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad94e8b-01dc-482e-8f76-f10777b20b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.693328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad94e8b-01dc-482e-8f76-f10777b20b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.695250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad94e8b-01dc-482e-8f76-f10777b20b6f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.696722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db4e6-51e4-4300-850f-b4b42bbc494b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.702881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b86df6-7c36-49e0-b55b-fb8c69370622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.703534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b86df6-7c36-49e0-b55b-fb8c69370622 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.703819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b86df6-7c36-49e0-b55b-fb8c69370622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.704098 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b86df6-7c36-49e0-b55b-fb8c69370622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.704785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b86df6-7c36-49e0-b55b-fb8c69370622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.706390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b86df6-7c36-49e0-b55b-fb8c69370622 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.717477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 953/1888] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:42.718541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b86df6-7c36-49e0-b55b-fb8c69370622 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.721999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a6b86df6-7c36-49e0-b55b-fb8c69370622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:42.729656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 936/1889] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:42 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:42.730985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad94e8b-01dc-482e-8f76-f10777b20b6f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.742031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b86df6-7c36-49e0-b55b-fb8c69370622 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.791091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:42.807324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad94e8b-01dc-482e-8f76-f10777b20b6f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.812353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.813303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.813733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c67d0-af00-4b8f-bc9a-6812ef3db55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.813855 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.814297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] PATH_INFO: `/v3/projects/8dd3f31d14fc4beead70e8385ffb7cc5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.814882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c67d0-af00-4b8f-bc9a-6812ef3db55c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.815315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c67d0-af00-4b8f-bc9a-6812ef3db55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.816536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd3f31d14fc4beead70e8385ffb7cc5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.816644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c67d0-af00-4b8f-bc9a-6812ef3db55c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.818427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c67d0-af00-4b8f-bc9a-6812ef3db55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.818957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.820066 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c67d0-af00-4b8f-bc9a-6812ef3db55c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.821690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:42.837379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 937/1890] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:42.837379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c67d0-af00-4b8f-bc9a-6812ef3db55c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.846746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c67d0-af00-4b8f-bc9a-6812ef3db55c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.854422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286f81c-049d-4ed2-adc3-3ebb522e2b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.855274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286f81c-049d-4ed2-adc3-3ebb522e2b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.855644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286f81c-049d-4ed2-adc3-3ebb522e2b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.855926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286f81c-049d-4ed2-adc3-3ebb522e2b16 admin admin] PATH_INFO: `/v3/projects/a8009afbb7df445b9d33b598bc250824/users/7b91f308a3e74ba5a1aa37c33ef6ef7b/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.858964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286f81c-049d-4ed2-adc3-3ebb522e2b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8009afbb7df445b9d33b598bc250824, user_id=7b91f308a3e74ba5a1aa37c33ef6ef7b, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.861648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286f81c-049d-4ed2-adc3-3ebb522e2b16 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:42.875677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 938/1891] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:42 2022] PUT /identity/v3/projects/a8009afbb7df445b9d33b598bc250824/users/7b91f308a3e74ba5a1aa37c33ef6ef7b/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:42.876500 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286f81c-049d-4ed2-adc3-3ebb522e2b16 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.890490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd3f31d14fc4beead70e8385ffb7cc5', 'request_id': 'req-b64d569a-5808-4478-93d1-06e2cd4ab4b3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:42.907500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd3f31d14fc4beead70e8385ffb7cc5', 'request_id': 'req-b64d569a-5808-4478-93d1-06e2cd4ab4b3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:42.925788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd3f31d14fc4beead70e8385ffb7cc5', 'request_id': 'req-b64d569a-5808-4478-93d1-06e2cd4ab4b3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:42.945090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] The token cache is being invalidate because project 8dd3f31d14fc4beead70e8385ffb7cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:42.945390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:42.946150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:42.948429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 954/1892] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:42 2022] DELETE /identity/v3/projects/8dd3f31d14fc4beead70e8385ffb7cc5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:42.952369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:42.953772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:42.970741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286f81c-049d-4ed2-adc3-3ebb522e2b16 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:42.975521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67666da-bd73-4daf-a447-5e2f58c60911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:42.976143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67666da-bd73-4daf-a447-5e2f58c60911 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:42.976497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67666da-bd73-4daf-a447-5e2f58c60911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:42.976858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67666da-bd73-4daf-a447-5e2f58c60911 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:42.977342 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67666da-bd73-4daf-a447-5e2f58c60911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:42.979529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67666da-bd73-4daf-a447-5e2f58c60911 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.007751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 939/1893] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:42 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:43.007751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9dd40-c3b3-4151-b110-5c75084c1006 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.007751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9dd40-c3b3-4151-b110-5c75084c1006 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.007751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9dd40-c3b3-4151-b110-5c75084c1006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.036099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-33b9dd40-c3b3-4151-b110-5c75084c1006 None None] MFA Rules not processed for user `7b91f308a3e74ba5a1aa37c33ef6ef7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:43.037351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-33b9dd40-c3b3-4151-b110-5c75084c1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.043316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d569a-5808-4478-93d1-06e2cd4ab4b3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:43.052635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3690f-08e3-4d24-b096-2569512ee38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:43.053793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3690f-08e3-4d24-b096-2569512ee38d admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.054662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3690f-08e3-4d24-b096-2569512ee38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.054978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3690f-08e3-4d24-b096-2569512ee38d admin admin] PATH_INFO: `/v3/projects/bf2ca1d898024e73b41616134db402d6/users/452ed832484d457590bc5a6e41ac4b0e/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.072974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3690f-08e3-4d24-b096-2569512ee38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2ca1d898024e73b41616134db402d6, user_id=452ed832484d457590bc5a6e41ac4b0e, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:43.076059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3690f-08e3-4d24-b096-2569512ee38d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.091813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 955/1894] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:42 2022] PUT /identity/v3/projects/bf2ca1d898024e73b41616134db402d6/users/452ed832484d457590bc5a6e41ac4b0e/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:43.093230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3690f-08e3-4d24-b096-2569512ee38d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:43.098194 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8ae3690f-08e3-4d24-b096-2569512ee38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.129044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 940/1895] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:43.130165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9dd40-c3b3-4151-b110-5c75084c1006 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:43.135508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-33b9dd40-c3b3-4151-b110-5c75084c1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.151683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9dd40-c3b3-4151-b110-5c75084c1006 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:43.180560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:43.186401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3690f-08e3-4d24-b096-2569512ee38d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:43.192973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:43.193694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.194551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.194831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] PATH_INFO: `/v3/users/94718eae0b044fb69db792239f60dbbc` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.196023 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94718eae0b044fb69db792239f60dbbc)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:43.199966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.219848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:43.230329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c984715-dd0c-45fc-8bb1-e687d08f9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:43.231063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c984715-dd0c-45fc-8bb1-e687d08f9d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.231424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c984715-dd0c-45fc-8bb1-e687d08f9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.231779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c984715-dd0c-45fc-8bb1-e687d08f9d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.232441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c984715-dd0c-45fc-8bb1-e687d08f9d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:43.234200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c984715-dd0c-45fc-8bb1-e687d08f9d91 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.247541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 941/1896] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:43.248731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c984715-dd0c-45fc-8bb1-e687d08f9d91 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:43.262156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c984715-dd0c-45fc-8bb1-e687d08f9d91 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:43.268935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94718eae0b044fb69db792239f60dbbc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:43.269481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27472435-a586-4e68-8bee-cb738caf6f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:43.270121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27472435-a586-4e68-8bee-cb738caf6f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.270541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27472435-a586-4e68-8bee-cb738caf6f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.270641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94718eae0b044fb69db792239f60dbbc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:43.270886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27472435-a586-4e68-8bee-cb738caf6f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.271557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27472435-a586-4e68-8bee-cb738caf6f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:43.273771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27472435-a586-4e68-8bee-cb738caf6f55 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.285082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94718eae0b044fb69db792239f60dbbc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:43.289303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 942/1897] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:43.290163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27472435-a586-4e68-8bee-cb738caf6f55 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:43.294312 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94718eae0b044fb69db792239f60dbbc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:43.294883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94718eae0b044fb69db792239f60dbbc'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:43.298287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-27472435-a586-4e68-8bee-cb738caf6f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.311624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 956/1898] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:43 2022] DELETE /identity/v3/users/94718eae0b044fb69db792239f60dbbc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:43.312505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:43.314101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.373971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27472435-a586-4e68-8bee-cb738caf6f55 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:43.425348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510421-44b5-4158-8782-28527fa953e2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:43.430981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6ecbd-a67f-4143-9d80-c16cbad609cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:43.438369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6ecbd-a67f-4143-9d80-c16cbad609cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.438796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6ecbd-a67f-4143-9d80-c16cbad609cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.439154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6ecbd-a67f-4143-9d80-c16cbad609cf admin admin] PATH_INFO: `/v3/projects/118c039f5cee424690dc05978e25dfd6/users/343335007828434cb1f5c88709d17589/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.455403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc66a3f-9782-4196-87fe-c2849041d215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:43.457018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66a3f-9782-4196-87fe-c2849041d215 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.458830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66a3f-9782-4196-87fe-c2849041d215 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.459502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66a3f-9782-4196-87fe-c2849041d215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.463369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6ecbd-a67f-4143-9d80-c16cbad609cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=118c039f5cee424690dc05978e25dfd6, user_id=343335007828434cb1f5c88709d17589, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:43.466591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0dc66a3f-9782-4196-87fe-c2849041d215 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.466791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6ecbd-a67f-4143-9d80-c16cbad609cf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.486423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 957/1899] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:43 2022] PUT /identity/v3/projects/118c039f5cee424690dc05978e25dfd6/users/343335007828434cb1f5c88709d17589/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:43.489569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6ecbd-a67f-4143-9d80-c16cbad609cf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:43.490726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-faf6ecbd-a67f-4143-9d80-c16cbad609cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.557742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc66a3f-9782-4196-87fe-c2849041d215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:43.572515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc66a3f-9782-4196-87fe-c2849041d215 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.575405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 943/1900] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:43.582177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:43.586666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc66a3f-9782-4196-87fe-c2849041d215 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:43.587152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6ecbd-a67f-4143-9d80-c16cbad609cf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:43.604937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc66a3f-9782-4196-87fe-c2849041d215 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:43.605082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65714235-36cd-4b66-bb48-f3d7d427cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:43.605901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65714235-36cd-4b66-bb48-f3d7d427cd52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.606261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65714235-36cd-4b66-bb48-f3d7d427cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.606685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65714235-36cd-4b66-bb48-f3d7d427cd52 admin admin] PATH_INFO: `/v3/projects/bf2ca1d898024e73b41616134db402d6/users/452ed832484d457590bc5a6e41ac4b0e/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.611025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65714235-36cd-4b66-bb48-f3d7d427cd52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2ca1d898024e73b41616134db402d6, user_id=452ed832484d457590bc5a6e41ac4b0e, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:43.613535 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326450a-96fd-4eef-809d-0f3ace7e2c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:43.614235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326450a-96fd-4eef-809d-0f3ace7e2c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.614537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326450a-96fd-4eef-809d-0f3ace7e2c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.614800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326450a-96fd-4eef-809d-0f3ace7e2c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.615450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326450a-96fd-4eef-809d-0f3ace7e2c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:43.617253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326450a-96fd-4eef-809d-0f3ace7e2c3b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.619706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65714235-36cd-4b66-bb48-f3d7d427cd52 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.639738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 944/1901] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:43.640698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326450a-96fd-4eef-809d-0f3ace7e2c3b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:43.655068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0326450a-96fd-4eef-809d-0f3ace7e2c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.661503 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 958/1902] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:43 2022] PUT /identity/v3/projects/bf2ca1d898024e73b41616134db402d6/users/452ed832484d457590bc5a6e41ac4b0e/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:43.662559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65714235-36cd-4b66-bb48-f3d7d427cd52 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:43.672297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326450a-96fd-4eef-809d-0f3ace7e2c3b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:43.714807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:43.746684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:43.747417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.747759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.748145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] PATH_INFO: `/v3/projects/9a1c17eb6a87460c90d77df9992b7776` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.749335 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1c17eb6a87460c90d77df9992b7776)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:43.751255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.767240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65714235-36cd-4b66-bb48-f3d7d427cd52 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:43.776514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27efa8cb-cd65-407a-9505-15cd9fde79bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:43.776514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efa8cb-cd65-407a-9505-15cd9fde79bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.776514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efa8cb-cd65-407a-9505-15cd9fde79bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.776514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efa8cb-cd65-407a-9505-15cd9fde79bf admin admin] PATH_INFO: `/v3/projects/118c039f5cee424690dc05978e25dfd6/users/343335007828434cb1f5c88709d17589/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.778736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27efa8cb-cd65-407a-9505-15cd9fde79bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=118c039f5cee424690dc05978e25dfd6, user_id=343335007828434cb1f5c88709d17589, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:43.782863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27efa8cb-cd65-407a-9505-15cd9fde79bf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:43.802286 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 959/1903] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:43 2022] PUT /identity/v3/projects/118c039f5cee424690dc05978e25dfd6/users/343335007828434cb1f5c88709d17589/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:43.804513 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c50e9-18b7-4a87-ad90-a7a43991d60d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.804868 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c50e9-18b7-4a87-ad90-a7a43991d60d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.805275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c50e9-18b7-4a87-ad90-a7a43991d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.825585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1c17eb6a87460c90d77df9992b7776', 'request_id': 'req-14fd84b7-604d-4d35-82f4-297029dcffb2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:43.833296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1c17eb6a87460c90d77df9992b7776', 'request_id': 'req-14fd84b7-604d-4d35-82f4-297029dcffb2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:43.843833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8a1c50e9-18b7-4a87-ad90-a7a43991d60d None None] MFA Rules not processed for user `452ed832484d457590bc5a6e41ac4b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:43.844060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1c17eb6a87460c90d77df9992b7776', 'request_id': 'req-14fd84b7-604d-4d35-82f4-297029dcffb2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:43.845515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8a1c50e9-18b7-4a87-ad90-a7a43991d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.861984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] The token cache is being invalidate because project 9a1c17eb6a87460c90d77df9992b7776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:43.862285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:43.862963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-14fd84b7-604d-4d35-82f4-297029dcffb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:43.864856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 945/1904] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:43 2022] DELETE /identity/v3/projects/9a1c17eb6a87460c90d77df9992b7776 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:43.866203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef9c7-cfdd-4a13-9285-3ea524ac0c3e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.866494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef9c7-cfdd-4a13-9285-3ea524ac0c3e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.866949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef9c7-cfdd-4a13-9285-3ea524ac0c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.903314 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-edbef9c7-cfdd-4a13-9285-3ea524ac0c3e None None] MFA Rules not processed for user `343335007828434cb1f5c88709d17589`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:43.905274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-edbef9c7-cfdd-4a13-9285-3ea524ac0c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.931800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 960/1905] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:43.933866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c988d-05f0-4c72-ac81-4008d3bcd4d0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:43.934301 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c988d-05f0-4c72-ac81-4008d3bcd4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:43.934599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c988d-05f0-4c72-ac81-4008d3bcd4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:43.966403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-785c988d-05f0-4c72-ac81-4008d3bcd4d0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:43.968202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-785c988d-05f0-4c72-ac81-4008d3bcd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:43.999439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 946/1906] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:44.009088 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef9c7-cfdd-4a13-9285-3ea524ac0c3e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.010709 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-edbef9c7-cfdd-4a13-9285-3ea524ac0c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.046269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 961/1907] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:44.046269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c988d-05f0-4c72-ac81-4008d3bcd4d0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.046994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-785c988d-05f0-4c72-ac81-4008d3bcd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.061113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:44.087497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef9c7-cfdd-4a13-9285-3ea524ac0c3e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.091341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3c4e3-d9f6-4de9-bab6-44b908272ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.092857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3c4e3-d9f6-4de9-bab6-44b908272ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.092857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3c4e3-d9f6-4de9-bab6-44b908272ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.093117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3c4e3-d9f6-4de9-bab6-44b908272ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.100436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:44.103349 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3c4e3-d9f6-4de9-bab6-44b908272ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.104907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3c4e3-d9f6-4de9-bab6-44b908272ad8 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.116670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 947/1908] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:44.118015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905d595-40cd-44d4-86b4-9bbfd5da2d92 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.118263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c988d-05f0-4c72-ac81-4008d3bcd4d0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.118440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905d595-40cd-44d4-86b4-9bbfd5da2d92 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.118825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905d595-40cd-44d4-86b4-9bbfd5da2d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.123043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072629d3-f8aa-4e32-96ed-8bd9f03152f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.123637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072629d3-f8aa-4e32-96ed-8bd9f03152f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.123959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072629d3-f8aa-4e32-96ed-8bd9f03152f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.124266 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072629d3-f8aa-4e32-96ed-8bd9f03152f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.126646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-072629d3-f8aa-4e32-96ed-8bd9f03152f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.150977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6905d595-40cd-44d4-86b4-9bbfd5da2d92 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:44.152276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6905d595-40cd-44d4-86b4-9bbfd5da2d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.163660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 948/1909] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:44.167512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905d595-40cd-44d4-86b4-9bbfd5da2d92 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.179139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905d595-40cd-44d4-86b4-9bbfd5da2d92 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.185640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b623622-ba6c-4cb6-9635-0034866d663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.186251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b623622-ba6c-4cb6-9635-0034866d663d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.186533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b623622-ba6c-4cb6-9635-0034866d663d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.186806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b623622-ba6c-4cb6-9635-0034866d663d admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.187507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b623622-ba6c-4cb6-9635-0034866d663d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:44.187813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b623622-ba6c-4cb6-9635-0034866d663d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.189943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b623622-ba6c-4cb6-9635-0034866d663d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.201751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072629d3-f8aa-4e32-96ed-8bd9f03152f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.204159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072629d3-f8aa-4e32-96ed-8bd9f03152f1 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.206673 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 949/1910] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:44.211100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b623622-ba6c-4cb6-9635-0034866d663d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.215913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 962/1911] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:44.222557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b623622-ba6c-4cb6-9635-0034866d663d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.235921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ae23e-8d86-4dee-8dd6-5eb49da7f2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.236696 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ae23e-8d86-4dee-8dd6-5eb49da7f2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.236981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ae23e-8d86-4dee-8dd6-5eb49da7f2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.237257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ae23e-8d86-4dee-8dd6-5eb49da7f2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.237890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ae23e-8d86-4dee-8dd6-5eb49da7f2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.240304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ae23e-8d86-4dee-8dd6-5eb49da7f2f6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.240922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072629d3-f8aa-4e32-96ed-8bd9f03152f1 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.242750 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-072629d3-f8aa-4e32-96ed-8bd9f03152f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.262657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072629d3-f8aa-4e32-96ed-8bd9f03152f1 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.268474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.269388 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.269757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.270192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] PATH_INFO: `/v3/users/efa878aa241846ea9491aead6595dce1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.271399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa878aa241846ea9491aead6595dce1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.273429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.280507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 950/1912] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:44 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:04:44.283821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ae23e-8d86-4dee-8dd6-5eb49da7f2f6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.334271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa878aa241846ea9491aead6595dce1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:44.335373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa878aa241846ea9491aead6595dce1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:44.351391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa878aa241846ea9491aead6595dce1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:44.360199 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa878aa241846ea9491aead6595dce1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:44.360932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa878aa241846ea9491aead6595dce1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:44.361358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ae23e-8d86-4dee-8dd6-5eb49da7f2f6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.366399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fcb16-c9f2-4de1-810b-b6926f86aff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.367054 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fcb16-c9f2-4de1-810b-b6926f86aff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.367367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fcb16-c9f2-4de1-810b-b6926f86aff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.367620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fcb16-c9f2-4de1-810b-b6926f86aff7 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.368308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fcb16-c9f2-4de1-810b-b6926f86aff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.370356 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fcb16-c9f2-4de1-810b-b6926f86aff7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.377240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 963/1913] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:44 2022] DELETE /identity/v3/users/efa878aa241846ea9491aead6595dce1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:44.378087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.379608 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.398545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 951/1914] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:44 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:44.402664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61e5c6-937a-4164-a1b7-59a853c75b7d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.402971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61e5c6-937a-4164-a1b7-59a853c75b7d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.403244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61e5c6-937a-4164-a1b7-59a853c75b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.423569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3a61e5c6-937a-4164-a1b7-59a853c75b7d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:44.425513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a61e5c6-937a-4164-a1b7-59a853c75b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.432343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:44.455738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f8948-d388-4b6b-b515-e757bfede1c5 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.460306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79d567-e42a-46b8-bac8-1ff2c1ca5615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.460976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d567-e42a-46b8-bac8-1ff2c1ca5615 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.461266 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d567-e42a-46b8-bac8-1ff2c1ca5615 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.461543 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d567-e42a-46b8-bac8-1ff2c1ca5615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.463344 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fc79d567-e42a-46b8-bac8-1ff2c1ca5615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.493437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 952/1915] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:44.494493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61e5c6-937a-4164-a1b7-59a853c75b7d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.499186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a61e5c6-937a-4164-a1b7-59a853c75b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.520037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61e5c6-937a-4164-a1b7-59a853c75b7d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.528706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab91e08-d522-4159-baea-9293dde3e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.530452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91e08-d522-4159-baea-9293dde3e337 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.531399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91e08-d522-4159-baea-9293dde3e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.531820 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab91e08-d522-4159-baea-9293dde3e337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.538553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab91e08-d522-4159-baea-9293dde3e337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.541133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab91e08-d522-4159-baea-9293dde3e337 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.549162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79d567-e42a-46b8-bac8-1ff2c1ca5615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.550839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79d567-e42a-46b8-bac8-1ff2c1ca5615 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.555139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 953/1916] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:44.557090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab91e08-d522-4159-baea-9293dde3e337 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.560294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dab91e08-d522-4159-baea-9293dde3e337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.563077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 964/1917] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:44.563932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79d567-e42a-46b8-bac8-1ff2c1ca5615 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.575925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79d567-e42a-46b8-bac8-1ff2c1ca5615 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.581961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e35757-3ab4-4c1a-98a6-626d82f8bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.582415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e35757-3ab4-4c1a-98a6-626d82f8bb73 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.582695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e35757-3ab4-4c1a-98a6-626d82f8bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.582998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e35757-3ab4-4c1a-98a6-626d82f8bb73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.583614 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e35757-3ab4-4c1a-98a6-626d82f8bb73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.585416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e35757-3ab4-4c1a-98a6-626d82f8bb73 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.597865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 965/1918] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:44.604107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e35757-3ab4-4c1a-98a6-626d82f8bb73 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.615913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e35757-3ab4-4c1a-98a6-626d82f8bb73 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.620278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:44.621650 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d181d8b-6465-4971-a316-4216a036126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.622510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181d8b-6465-4971-a316-4216a036126d admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.622803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181d8b-6465-4971-a316-4216a036126d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.623651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d181d8b-6465-4971-a316-4216a036126d admin admin] PATH_INFO: `/v3/projects/da820ca19ffb4ef59a68e66a4cc063ce/users/3d9845dc9ba9427dbfea5316f12e0670/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.642298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d181d8b-6465-4971-a316-4216a036126d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da820ca19ffb4ef59a68e66a4cc063ce, user_id=3d9845dc9ba9427dbfea5316f12e0670, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.646374 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d181d8b-6465-4971-a316-4216a036126d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.679452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 966/1919] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:44 2022] PUT /identity/v3/projects/da820ca19ffb4ef59a68e66a4cc063ce/users/3d9845dc9ba9427dbfea5316f12e0670/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:44.692281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449536-62d4-4fbd-93b1-693b75d85557 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.692603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449536-62d4-4fbd-93b1-693b75d85557 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.692875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449536-62d4-4fbd-93b1-693b75d85557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.701190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab91e08-d522-4159-baea-9293dde3e337 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:44.759933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cf449536-62d4-4fbd-93b1-693b75d85557 None None] MFA Rules not processed for user `3d9845dc9ba9427dbfea5316f12e0670`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:44.761349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cf449536-62d4-4fbd-93b1-693b75d85557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:44.828254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec9728-e6d1-47ca-9801-a0c6466f0b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:44.828947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec9728-e6d1-47ca-9801-a0c6466f0b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:44.829248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec9728-e6d1-47ca-9801-a0c6466f0b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:44.829455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec9728-e6d1-47ca-9801-a0c6466f0b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:44.921170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 967/1920] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:44.927411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449536-62d4-4fbd-93b1-693b75d85557 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:44.958474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec9728-e6d1-47ca-9801-a0c6466f0b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:44.960223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec9728-e6d1-47ca-9801-a0c6466f0b3d service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:44.982813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 954/1921] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:45.041450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:45.075071 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449536-62d4-4fbd-93b1-693b75d85557 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:45.084602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648c621-701a-47dd-8f34-9b66a3ec2458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:45.086838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c621-701a-47dd-8f34-9b66a3ec2458 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:45.087293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c621-701a-47dd-8f34-9b66a3ec2458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:45.088516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c621-701a-47dd-8f34-9b66a3ec2458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:45.092238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648c621-701a-47dd-8f34-9b66a3ec2458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:45.098122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648c621-701a-47dd-8f34-9b66a3ec2458 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:45.100410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec9728-e6d1-47ca-9801-a0c6466f0b3d service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:45.102023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a2ec9728-e6d1-47ca-9801-a0c6466f0b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:45.131535 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec9728-e6d1-47ca-9801-a0c6466f0b3d service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:45.166182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:45.167162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:45.167446 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:45.167722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] PATH_INFO: `/v3/users/2ebc8b562fc84077b9aec4f12cb818ba` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:45.169782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ebc8b562fc84077b9aec4f12cb818ba)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:45.179868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:45.194813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 968/1922] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:44 2022] POST /identity/v3/projects => generated 379 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:45.200181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648c621-701a-47dd-8f34-9b66a3ec2458 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:45.313642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648c621-701a-47dd-8f34-9b66a3ec2458 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:45.316847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ebc8b562fc84077b9aec4f12cb818ba'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.320877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe5390-553d-4c09-8772-e64268f7af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:45.321903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe5390-553d-4c09-8772-e64268f7af23 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:45.322370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe5390-553d-4c09-8772-e64268f7af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:45.322777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe5390-553d-4c09-8772-e64268f7af23 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:45.323431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe5390-553d-4c09-8772-e64268f7af23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:45.327333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe5390-553d-4c09-8772-e64268f7af23 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:45.342634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ebc8b562fc84077b9aec4f12cb818ba'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.343282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ebc8b562fc84077b9aec4f12cb818ba'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.343955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ebc8b562fc84077b9aec4f12cb818ba'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.359465 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d2e0c941-793c-4f4c-acb3-01590eeaf325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ebc8b562fc84077b9aec4f12cb818ba'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.366031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 969/1923] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:45 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:45.370636 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe5390-553d-4c09-8772-e64268f7af23 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:45.374656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c4fe5390-553d-4c09-8772-e64268f7af23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:45.395062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe5390-553d-4c09-8772-e64268f7af23 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:45.396749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 955/1924] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:45 2022] DELETE /identity/v3/users/2ebc8b562fc84077b9aec4f12cb818ba => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:45.401550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce8ca4-0613-4199-9c85-34f8ba9fd665 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:45.401958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce8ca4-0613-4199-9c85-34f8ba9fd665 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:45.402240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce8ca4-0613-4199-9c85-34f8ba9fd665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:45.429672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-12ce8ca4-0613-4199-9c85-34f8ba9fd665 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:45.431597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-12ce8ca4-0613-4199-9c85-34f8ba9fd665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:45.439305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:45.511265 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 956/1925] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:45.518196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce8ca4-0613-4199-9c85-34f8ba9fd665 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:45.520097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-12ce8ca4-0613-4199-9c85-34f8ba9fd665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:45.520966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd355e5-9f36-44c0-a360-8a6b7402d709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:45.521591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd355e5-9f36-44c0-a360-8a6b7402d709 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:45.521874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd355e5-9f36-44c0-a360-8a6b7402d709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:45.522151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd355e5-9f36-44c0-a360-8a6b7402d709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:45.522844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd355e5-9f36-44c0-a360-8a6b7402d709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:45.524480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd355e5-9f36-44c0-a360-8a6b7402d709 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:45.564517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 970/1926] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:45.564517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd355e5-9f36-44c0-a360-8a6b7402d709 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:45.564517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9bd355e5-9f36-44c0-a360-8a6b7402d709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:45.586052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd355e5-9f36-44c0-a360-8a6b7402d709 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:45.591543 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:45.592810 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:45.593119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:45.593400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] PATH_INFO: `/v3/projects/bef467cdc3c043ba8bcfe4c5abeb3d64` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:45.594551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef467cdc3c043ba8bcfe4c5abeb3d64)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:45.596606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:45.598618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce8ca4-0613-4199-9c85-34f8ba9fd665 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:45.602350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ccc2e-4ac9-4f5f-8302-25a4926d9f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:45.603230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ccc2e-4ac9-4f5f-8302-25a4926d9f59 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:45.603507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ccc2e-4ac9-4f5f-8302-25a4926d9f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:45.603777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ccc2e-4ac9-4f5f-8302-25a4926d9f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:45.613378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ccc2e-4ac9-4f5f-8302-25a4926d9f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:45.614821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ccc2e-4ac9-4f5f-8302-25a4926d9f59 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:45.626687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 957/1927] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:45.627510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ccc2e-4ac9-4f5f-8302-25a4926d9f59 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:45.639211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ccc2e-4ac9-4f5f-8302-25a4926d9f59 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:45.688019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef467cdc3c043ba8bcfe4c5abeb3d64', 'request_id': 'req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.693642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:45.706187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef467cdc3c043ba8bcfe4c5abeb3d64', 'request_id': 'req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.718919 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef467cdc3c043ba8bcfe4c5abeb3d64', 'request_id': 'req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.729422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2e33e-c019-4d5a-b270-dcb0e940079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:45.730414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e33e-c019-4d5a-b270-dcb0e940079a admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:45.730695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e33e-c019-4d5a-b270-dcb0e940079a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:45.731044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2e33e-c019-4d5a-b270-dcb0e940079a admin admin] PATH_INFO: `/v3/projects/0846e889cb35438a9088aaef54ade661/users/299bd2f7025a4006a3c59f47903c52ee/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:45.733686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] The token cache is being invalidate because project bef467cdc3c043ba8bcfe4c5abeb3d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:45.734369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.734927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.737999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 971/1928] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:45 2022] DELETE /identity/v3/projects/bef467cdc3c043ba8bcfe4c5abeb3d64 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:45.742007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:45.743929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:45.756062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2e33e-c019-4d5a-b270-dcb0e940079a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0846e889cb35438a9088aaef54ade661, user_id=299bd2f7025a4006a3c59f47903c52ee, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:45.759147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2e33e-c019-4d5a-b270-dcb0e940079a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:45.764689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d66a3-4fc0-4d8d-9f9e-160362623b72 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:45.770968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:45.772013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:45.772307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:45.772647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] PATH_INFO: `/v3/users/7b91f308a3e74ba5a1aa37c33ef6ef7b` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:45.774190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b91f308a3e74ba5a1aa37c33ef6ef7b)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:45.776453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:45.782435 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 958/1929] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:45 2022] PUT /identity/v3/projects/0846e889cb35438a9088aaef54ade661/users/299bd2f7025a4006a3c59f47903c52ee/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:45.783765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2e33e-c019-4d5a-b270-dcb0e940079a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:45.787603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7df2e33e-c019-4d5a-b270-dcb0e940079a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:45.864834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:45.876152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b91f308a3e74ba5a1aa37c33ef6ef7b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.877669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b91f308a3e74ba5a1aa37c33ef6ef7b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.901027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b91f308a3e74ba5a1aa37c33ef6ef7b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.909008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2e33e-c019-4d5a-b270-dcb0e940079a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:45.910885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b91f308a3e74ba5a1aa37c33ef6ef7b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.912057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b91f308a3e74ba5a1aa37c33ef6ef7b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:45.915786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a52710-cc96-494a-b5d8-fca053457080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:45.916786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a52710-cc96-494a-b5d8-fca053457080 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:45.917405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a52710-cc96-494a-b5d8-fca053457080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:45.917990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a52710-cc96-494a-b5d8-fca053457080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:45.918939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a52710-cc96-494a-b5d8-fca053457080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:45.921968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a52710-cc96-494a-b5d8-fca053457080 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:45.930231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 972/1930] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:45 2022] DELETE /identity/v3/users/7b91f308a3e74ba5a1aa37c33ef6ef7b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:45.935344 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 959/1931] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:45.941727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:45.943503 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.004231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a52710-cc96-494a-b5d8-fca053457080 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:46.006229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-08a52710-cc96-494a-b5d8-fca053457080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.027241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a52710-cc96-494a-b5d8-fca053457080 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:46.068004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d5ccb-8dc0-424e-8c97-0014ab48a75b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:46.075352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88958e87-d9d1-48be-b999-0592be5c6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:46.076283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88958e87-d9d1-48be-b999-0592be5c6cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:46.076649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88958e87-d9d1-48be-b999-0592be5c6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:46.076934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88958e87-d9d1-48be-b999-0592be5c6cbe admin admin] PATH_INFO: `/v3/projects/0846e889cb35438a9088aaef54ade661/users/299bd2f7025a4006a3c59f47903c52ee/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:46.079325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88958e87-d9d1-48be-b999-0592be5c6cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0846e889cb35438a9088aaef54ade661, user_id=299bd2f7025a4006a3c59f47903c52ee, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:46.082149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88958e87-d9d1-48be-b999-0592be5c6cbe admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:46.112241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 973/1932] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:45 2022] PUT /identity/v3/projects/0846e889cb35438a9088aaef54ade661/users/299bd2f7025a4006a3c59f47903c52ee/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:46.114702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af3313-037f-475c-be27-044c258d00a6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:46.115000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af3313-037f-475c-be27-044c258d00a6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:46.115283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af3313-037f-475c-be27-044c258d00a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:46.176362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:46.177051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:46.177335 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:46.177619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] PATH_INFO: `/v3/projects/bbe3556e449846fe877631a876d7c89c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:46.179156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe3556e449846fe877631a876d7c89c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:46.181948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:46.235034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-02af3313-037f-475c-be27-044c258d00a6 None None] MFA Rules not processed for user `299bd2f7025a4006a3c59f47903c52ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:46.239115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-02af3313-037f-475c-be27-044c258d00a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.294294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe3556e449846fe877631a876d7c89c', 'request_id': 'req-0d16a0df-c232-4705-8e36-43ccd57b174f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.302200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe3556e449846fe877631a876d7c89c', 'request_id': 'req-0d16a0df-c232-4705-8e36-43ccd57b174f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.316920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe3556e449846fe877631a876d7c89c', 'request_id': 'req-0d16a0df-c232-4705-8e36-43ccd57b174f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.328404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:46.343552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] The token cache is being invalidate because project bbe3556e449846fe877631a876d7c89c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:46.344596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.345962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.352919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 960/1933] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:46 2022] DELETE /identity/v3/projects/bbe3556e449846fe877631a876d7c89c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:46.370051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:46.372984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.406473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 974/1934] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:46.420212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af3313-037f-475c-be27-044c258d00a6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:46.421943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-02af3313-037f-475c-be27-044c258d00a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.474966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16a0df-c232-4705-8e36-43ccd57b174f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:46.487269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:46.487982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:46.488407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:46.488759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] PATH_INFO: `/v3/users/3911ed19b604486f980cba58187a3cd9` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:46.490119 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3911ed19b604486f980cba58187a3cd9)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:46.492091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:46.506497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:46.547109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af3313-037f-475c-be27-044c258d00a6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:46.557261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec591979-bd9c-45fb-9c04-cb19b6a9ad6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:46.558181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec591979-bd9c-45fb-9c04-cb19b6a9ad6b service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:46.558863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec591979-bd9c-45fb-9c04-cb19b6a9ad6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:46.559378 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec591979-bd9c-45fb-9c04-cb19b6a9ad6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:46.561556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3911ed19b604486f980cba58187a3cd9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.571530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3911ed19b604486f980cba58187a3cd9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.572388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3911ed19b604486f980cba58187a3cd9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.573202 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3911ed19b604486f980cba58187a3cd9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.581395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3911ed19b604486f980cba58187a3cd9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.583336 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec591979-bd9c-45fb-9c04-cb19b6a9ad6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:46.584831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec591979-bd9c-45fb-9c04-cb19b6a9ad6b service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:46.596803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 975/1935] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:46.597678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec591979-bd9c-45fb-9c04-cb19b6a9ad6b service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:46.599044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ec591979-bd9c-45fb-9c04-cb19b6a9ad6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.610928 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 961/1936] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:46 2022] DELETE /identity/v3/users/3911ed19b604486f980cba58187a3cd9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:46.621336 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec591979-bd9c-45fb-9c04-cb19b6a9ad6b service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:46.688369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:46.690375 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.709728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:46.710778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:46.711239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:46.711693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] PATH_INFO: `/v3/projects/a8009afbb7df445b9d33b598bc250824` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:46.712893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8009afbb7df445b9d33b598bc250824)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:46.715065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:46.772272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67e698-4b7a-4e41-9be5-584e6b14fc89 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:46.784863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8009afbb7df445b9d33b598bc250824', 'request_id': 'req-f1c5e300-9d34-44b5-bd36-0ea3170c0713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.795703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8009afbb7df445b9d33b598bc250824', 'request_id': 'req-f1c5e300-9d34-44b5-bd36-0ea3170c0713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.805317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8009afbb7df445b9d33b598bc250824', 'request_id': 'req-f1c5e300-9d34-44b5-bd36-0ea3170c0713'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.820654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] The token cache is being invalidate because project a8009afbb7df445b9d33b598bc250824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:46.820938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.821816 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1c5e300-9d34-44b5-bd36-0ea3170c0713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:46.823386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 976/1937] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:46 2022] DELETE /identity/v3/projects/a8009afbb7df445b9d33b598bc250824 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:46.830128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a2359-1ca7-4b39-97b7-3c14143c6825 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:46.830437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a2359-1ca7-4b39-97b7-3c14143c6825 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:46.830714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a2359-1ca7-4b39-97b7-3c14143c6825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:46.844591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:46.847278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702224db-a0ed-4f3e-b4d3-2e49f1ae8793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:46.850031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702224db-a0ed-4f3e-b4d3-2e49f1ae8793 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:46.850321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702224db-a0ed-4f3e-b4d3-2e49f1ae8793 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:46.850603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702224db-a0ed-4f3e-b4d3-2e49f1ae8793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:46.858177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-702224db-a0ed-4f3e-b4d3-2e49f1ae8793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.859846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3b5a2359-1ca7-4b39-97b7-3c14143c6825 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:46.861776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3b5a2359-1ca7-4b39-97b7-3c14143c6825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.935376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:46.948639 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 977/1938] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:46.952436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702224db-a0ed-4f3e-b4d3-2e49f1ae8793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:46.953938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702224db-a0ed-4f3e-b4d3-2e49f1ae8793 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:46.954597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d0e6-52ec-45ef-a9f7-34ed68ac09cf None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:46.954927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d0e6-52ec-45ef-a9f7-34ed68ac09cf None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:46.955212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d0e6-52ec-45ef-a9f7-34ed68ac09cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:46.973085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 962/1939] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:46.973993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702224db-a0ed-4f3e-b4d3-2e49f1ae8793 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:46.977882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-702224db-a0ed-4f3e-b4d3-2e49f1ae8793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.989171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-62e7d0e6-52ec-45ef-a9f7-34ed68ac09cf None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:46.990755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-62e7d0e6-52ec-45ef-a9f7-34ed68ac09cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:46.991407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702224db-a0ed-4f3e-b4d3-2e49f1ae8793 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:46.995910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55e04c-84af-44b8-a21d-181302de4c97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:46.996637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e04c-84af-44b8-a21d-181302de4c97 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:46.996922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e04c-84af-44b8-a21d-181302de4c97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:46.997200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55e04c-84af-44b8-a21d-181302de4c97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.000261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5a55e04c-84af-44b8-a21d-181302de4c97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:47.002012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 978/1940] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:47.006357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d0e6-52ec-45ef-a9f7-34ed68ac09cf None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:47.017814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d0e6-52ec-45ef-a9f7-34ed68ac09cf None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:47.026553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4254373-a00a-43a2-9206-d9893c404297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:47.027897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4254373-a00a-43a2-9206-d9893c404297 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.029313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4254373-a00a-43a2-9206-d9893c404297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.030284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4254373-a00a-43a2-9206-d9893c404297 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.030791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4254373-a00a-43a2-9206-d9893c404297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:47.031100 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4254373-a00a-43a2-9206-d9893c404297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:47.035148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4254373-a00a-43a2-9206-d9893c404297 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:47.060263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 979/1941] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:47.065969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4254373-a00a-43a2-9206-d9893c404297 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:47.088000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4254373-a00a-43a2-9206-d9893c404297 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:47.094920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b986a-7ccf-4d30-aca9-360be398e587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:47.095920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b986a-7ccf-4d30-aca9-360be398e587 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.096061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b986a-7ccf-4d30-aca9-360be398e587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.096231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b986a-7ccf-4d30-aca9-360be398e587 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.097311 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b986a-7ccf-4d30-aca9-360be398e587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:47.099611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b986a-7ccf-4d30-aca9-360be398e587 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:47.105833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55e04c-84af-44b8-a21d-181302de4c97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:47.108873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55e04c-84af-44b8-a21d-181302de4c97 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:47.130212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 963/1942] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:47.154941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 980/1943] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:47 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:47.155977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55e04c-84af-44b8-a21d-181302de4c97 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:47.172184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55e04c-84af-44b8-a21d-181302de4c97 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:47.245025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b986a-7ccf-4d30-aca9-360be398e587 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:47.246791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-630b986a-7ccf-4d30-aca9-360be398e587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:47.315996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110657-29ab-47ea-88d4-88bfb7189958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:47.317091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110657-29ab-47ea-88d4-88bfb7189958 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.317091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110657-29ab-47ea-88d4-88bfb7189958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.317366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110657-29ab-47ea-88d4-88bfb7189958 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.317965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49110657-29ab-47ea-88d4-88bfb7189958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:47.322762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49110657-29ab-47ea-88d4-88bfb7189958 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:47.364891 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b986a-7ccf-4d30-aca9-360be398e587 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:47.378612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:47.379289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.379668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.379960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] PATH_INFO: `/v3/projects/ecc3312a2a5b4d1794ed215e21f73eb1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.383137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 964/1944] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:47 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:47.385480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc3312a2a5b4d1794ed215e21f73eb1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:47.387109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110657-29ab-47ea-88d4-88bfb7189958 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:47.387952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:47.421329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110657-29ab-47ea-88d4-88bfb7189958 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:47.432952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b951757-7625-488f-80ee-3431631688bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:47.435636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b951757-7625-488f-80ee-3431631688bc admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.437189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b951757-7625-488f-80ee-3431631688bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.437958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b951757-7625-488f-80ee-3431631688bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.438766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b951757-7625-488f-80ee-3431631688bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:47.441610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b951757-7625-488f-80ee-3431631688bc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:47.451659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc3312a2a5b4d1794ed215e21f73eb1', 'request_id': 'req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:47.462958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 965/1945] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:04:47.467634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b951757-7625-488f-80ee-3431631688bc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:47.467905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc3312a2a5b4d1794ed215e21f73eb1', 'request_id': 'req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:47.480065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b951757-7625-488f-80ee-3431631688bc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:47.483401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc3312a2a5b4d1794ed215e21f73eb1', 'request_id': 'req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:47.493129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:47.505485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] The token cache is being invalidate because project ecc3312a2a5b4d1794ed215e21f73eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:47.505789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:47.507442 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cab23dfa-cacc-4966-b383-5c1fa5a9e41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:47.511092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 981/1946] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:47 2022] DELETE /identity/v3/projects/ecc3312a2a5b4d1794ed215e21f73eb1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:47.518968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa92bae-9de0-4610-a93c-4e73ecc094c2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.519299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa92bae-9de0-4610-a93c-4e73ecc094c2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.519800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa92bae-9de0-4610-a93c-4e73ecc094c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.568246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ffa92bae-9de0-4610-a93c-4e73ecc094c2 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:47.569681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ffa92bae-9de0-4610-a93c-4e73ecc094c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:47.649173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802688-6dd4-409f-88e5-aa8887cba707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:47.649866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802688-6dd4-409f-88e5-aa8887cba707 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.650158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802688-6dd4-409f-88e5-aa8887cba707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.650437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802688-6dd4-409f-88e5-aa8887cba707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.651314 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802688-6dd4-409f-88e5-aa8887cba707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:47.653228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802688-6dd4-409f-88e5-aa8887cba707 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:47.682338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 966/1947] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:47.683408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802688-6dd4-409f-88e5-aa8887cba707 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:47.687481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-75802688-6dd4-409f-88e5-aa8887cba707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:47.699126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:47.710100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802688-6dd4-409f-88e5-aa8887cba707 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:47.717688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:47.718532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.719821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.720342 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] PATH_INFO: `/v3/users/12d0dfcfe2384ccf84be2eb64fa071f3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.722270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d0dfcfe2384ccf84be2eb64fa071f3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:47.724198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 982/1948] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:47.725564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa92bae-9de0-4610-a93c-4e73ecc094c2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:47.726297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:47.727317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ffa92bae-9de0-4610-a93c-4e73ecc094c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:47.775667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa92bae-9de0-4610-a93c-4e73ecc094c2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:47.786324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3974b76-e28b-4619-9f76-458ab5b0759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:47.787291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3974b76-e28b-4619-9f76-458ab5b0759e admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.787586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3974b76-e28b-4619-9f76-458ab5b0759e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.787975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3974b76-e28b-4619-9f76-458ab5b0759e admin admin] PATH_INFO: `/v3/projects/321b0dbd7a0b47ad9c215a0fe3c7c486/users/3ed9a0e9a6324e59ab983cc0076d7009/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.815078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3974b76-e28b-4619-9f76-458ab5b0759e admin admin] RBAC: Authorizing `identity:create_grant(project_id=321b0dbd7a0b47ad9c215a0fe3c7c486, user_id=3ed9a0e9a6324e59ab983cc0076d7009, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:47.818250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3974b76-e28b-4619-9f76-458ab5b0759e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:47.850887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 983/1949] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:47 2022] PUT /identity/v3/projects/321b0dbd7a0b47ad9c215a0fe3c7c486/users/3ed9a0e9a6324e59ab983cc0076d7009/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:47.862318 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bff71d-0b0d-4805-b572-1ae9136c212f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.862772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bff71d-0b0d-4805-b572-1ae9136c212f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.863205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bff71d-0b0d-4805-b572-1ae9136c212f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.867470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d0dfcfe2384ccf84be2eb64fa071f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:47.880491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d0dfcfe2384ccf84be2eb64fa071f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:47.881598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d0dfcfe2384ccf84be2eb64fa071f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:47.883240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d0dfcfe2384ccf84be2eb64fa071f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:47.893976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-07bff71d-0b0d-4805-b572-1ae9136c212f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:47.895184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-07bff71d-0b0d-4805-b572-1ae9136c212f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:47.898270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-483c8127-f48d-4e57-b2c1-2d1f72b8260a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d0dfcfe2384ccf84be2eb64fa071f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:47.923998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 967/1950] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:47 2022] DELETE /identity/v3/users/12d0dfcfe2384ccf84be2eb64fa071f3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:47.925671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db018626-8cea-4ba5-a426-ccdbe848c62f None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.925957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db018626-8cea-4ba5-a426-ccdbe848c62f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.926233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db018626-8cea-4ba5-a426-ccdbe848c62f None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.927972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 968/1951] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:04:47.935038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72bf8b-809c-4466-a502-22ef14a13ea0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.935325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72bf8b-809c-4466-a502-22ef14a13ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.935653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72bf8b-809c-4466-a502-22ef14a13ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.989587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 984/1952] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:47.992617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1328f9-3388-4265-ae7b-4d408a450e22 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:47.992907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1328f9-3388-4265-ae7b-4d408a450e22 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:47.993250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1328f9-3388-4265-ae7b-4d408a450e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:47.997809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4c72bf8b-809c-4466-a502-22ef14a13ea0 None None] MFA Rules not processed for user `3ed9a0e9a6324e59ab983cc0076d7009`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:48.000408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4c72bf8b-809c-4466-a502-22ef14a13ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:48.038132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cc1328f9-3388-4265-ae7b-4d408a450e22 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:48.039381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cc1328f9-3388-4265-ae7b-4d408a450e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:48.085544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 969/1953] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:48.093032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af300ad5-e110-42c6-a581-c7c5732c0a3c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:48.093881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af300ad5-e110-42c6-a581-c7c5732c0a3c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:48.093881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af300ad5-e110-42c6-a581-c7c5732c0a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:48.134812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 985/1954] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:48.139579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1328f9-3388-4265-ae7b-4d408a450e22 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:48.150364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-af300ad5-e110-42c6-a581-c7c5732c0a3c None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:48.151652 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1328f9-3388-4265-ae7b-4d408a450e22 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:48.151935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-af300ad5-e110-42c6-a581-c7c5732c0a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:48.159742 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1ada8-3e5c-4107-bc7f-3932d3535f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:48.162786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1ada8-3e5c-4107-bc7f-3932d3535f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:48.163145 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1ada8-3e5c-4107-bc7f-3932d3535f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:48.164061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1ada8-3e5c-4107-bc7f-3932d3535f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:48.166031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1ada8-3e5c-4107-bc7f-3932d3535f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:48.166357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1ada8-3e5c-4107-bc7f-3932d3535f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:48.170783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1ada8-3e5c-4107-bc7f-3932d3535f46 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:48.205467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:48.220315 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 986/1955] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:48.223349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1ada8-3e5c-4107-bc7f-3932d3535f46 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:48.228771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f3b1ada8-3e5c-4107-bc7f-3932d3535f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:48.302097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:48.325348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 970/1956] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:04:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:48.327859 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af300ad5-e110-42c6-a581-c7c5732c0a3c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:48.329674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-af300ad5-e110-42c6-a581-c7c5732c0a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:48.413246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1ada8-3e5c-4107-bc7f-3932d3535f46 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:48.421445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961d821-eaa5-47b2-a90a-4a03159dca7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a710cfeadd004a8bbf932f6bb3b211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:48.421865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af300ad5-e110-42c6-a581-c7c5732c0a3c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:48.422087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d821-eaa5-47b2-a90a-4a03159dca7d service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:48.422371 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d821-eaa5-47b2-a90a-4a03159dca7d service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:48.422650 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d821-eaa5-47b2-a90a-4a03159dca7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:48.426255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af47aca-1ee5-4387-8690-6bf8bbb867a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:48.427046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af47aca-1ee5-4387-8690-6bf8bbb867a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:48.427404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af47aca-1ee5-4387-8690-6bf8bbb867a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:48.427747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af47aca-1ee5-4387-8690-6bf8bbb867a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:48.434479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961d821-eaa5-47b2-a90a-4a03159dca7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:48.436672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961d821-eaa5-47b2-a90a-4a03159dca7d service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:48.440706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af47aca-1ee5-4387-8690-6bf8bbb867a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:48.442381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af47aca-1ee5-4387-8690-6bf8bbb867a1 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:48.447288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 987/1957] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:48.447924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961d821-eaa5-47b2-a90a-4a03159dca7d service glance] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:48.462706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 971/1958] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:48.463375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961d821-eaa5-47b2-a90a-4a03159dca7d service glance] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:48.463576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af47aca-1ee5-4387-8690-6bf8bbb867a1 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:48.464950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7af47aca-1ee5-4387-8690-6bf8bbb867a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:48.473502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a20451-6d19-4735-95e9-c55b792457be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:48.474136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a20451-6d19-4735-95e9-c55b792457be admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:48.474418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a20451-6d19-4735-95e9-c55b792457be admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:48.474693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a20451-6d19-4735-95e9-c55b792457be admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:48.475329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a20451-6d19-4735-95e9-c55b792457be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:48.483439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af47aca-1ee5-4387-8690-6bf8bbb867a1 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:48.488622 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a20451-6d19-4735-95e9-c55b792457be admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:48.489675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac8b8-398c-4a82-818e-14b67b65c3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:48.490299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac8b8-398c-4a82-818e-14b67b65c3ac service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:48.490576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac8b8-398c-4a82-818e-14b67b65c3ac service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:48.490847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac8b8-398c-4a82-818e-14b67b65c3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:48.502912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeac8b8-398c-4a82-818e-14b67b65c3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:48.505228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeac8b8-398c-4a82-818e-14b67b65c3ac service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:48.520114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 972/1959] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:48.558638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 988/1960] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:48 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:48.559454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac8b8-398c-4a82-818e-14b67b65c3ac service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:48.578913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac8b8-398c-4a82-818e-14b67b65c3ac service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:48.789338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1cb41-da64-4057-8809-44ab238ce09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:48.790531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1cb41-da64-4057-8809-44ab238ce09b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:48.790959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1cb41-da64-4057-8809-44ab238ce09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:48.792430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1cb41-da64-4057-8809-44ab238ce09b admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:48.793317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1cb41-da64-4057-8809-44ab238ce09b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:48.795620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1cb41-da64-4057-8809-44ab238ce09b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:48.856955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 973/1961] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:48 2022] POST /identity/v3/users => generated 282 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:04:48.860986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a20451-6d19-4735-95e9-c55b792457be admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:48.876830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a20451-6d19-4735-95e9-c55b792457be admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:48.891660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880916d-5e96-4df9-a099-f20d45e01ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:48.898082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880916d-5e96-4df9-a099-f20d45e01ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:48.898446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880916d-5e96-4df9-a099-f20d45e01ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:48.900120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880916d-5e96-4df9-a099-f20d45e01ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:48.900863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880916d-5e96-4df9-a099-f20d45e01ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:48.905820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880916d-5e96-4df9-a099-f20d45e01ca1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:48.941693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 989/1962] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:48.942760 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1cb41-da64-4057-8809-44ab238ce09b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:48.969523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1cb41-da64-4057-8809-44ab238ce09b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:48.978619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035e465-8fa8-468c-8f04-f65606bb680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:48.979252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035e465-8fa8-468c-8f04-f65606bb680f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:48.979534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035e465-8fa8-468c-8f04-f65606bb680f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:48.979809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035e465-8fa8-468c-8f04-f65606bb680f admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:48.980481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035e465-8fa8-468c-8f04-f65606bb680f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:48.982099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035e465-8fa8-468c-8f04-f65606bb680f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:49.004227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 974/1963] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:04:49.009346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880916d-5e96-4df9-a099-f20d45e01ca1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:49.028025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880916d-5e96-4df9-a099-f20d45e01ca1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:49.040395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2fb01-e7e8-4e37-8fb9-b0c9d3954e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:49.042470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2fb01-e7e8-4e37-8fb9-b0c9d3954e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:49.042749 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2fb01-e7e8-4e37-8fb9-b0c9d3954e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:49.043126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2fb01-e7e8-4e37-8fb9-b0c9d3954e21 admin admin] PATH_INFO: `/v3/projects/5d10b16104084359b524daeb688269e3/users/8fdb58cce4944cc88e432ff8bcf2d50f/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:49.088165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2fb01-e7e8-4e37-8fb9-b0c9d3954e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d10b16104084359b524daeb688269e3, user_id=8fdb58cce4944cc88e432ff8bcf2d50f, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:49.091139 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2fb01-e7e8-4e37-8fb9-b0c9d3954e21 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:49.113152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 990/1964] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:49 2022] PUT /identity/v3/projects/5d10b16104084359b524daeb688269e3/users/8fdb58cce4944cc88e432ff8bcf2d50f/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:49.124892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678b6c-d297-47f3-9ea0-ab277eb09f37 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:49.125208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678b6c-d297-47f3-9ea0-ab277eb09f37 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:49.125805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98678b6c-d297-47f3-9ea0-ab277eb09f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:49.183520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-98678b6c-d297-47f3-9ea0-ab277eb09f37 None None] MFA Rules not processed for user `8fdb58cce4944cc88e432ff8bcf2d50f`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:49.183520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-98678b6c-d297-47f3-9ea0-ab277eb09f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:49.185042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2fb01-e7e8-4e37-8fb9-b0c9d3954e21 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:49.186923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6ae2fb01-e7e8-4e37-8fb9-b0c9d3954e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:49.352957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:49.366654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2fb01-e7e8-4e37-8fb9-b0c9d3954e21 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:49.374904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 975/1965] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:49.379027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:49.379420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98678b6c-d297-47f3-9ea0-ab277eb09f37 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:49.380274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:49.381142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:49.381651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] PATH_INFO: `/v3/projects/9affd09af02440e0843c47c41044e818` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:49.383408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9affd09af02440e0843c47c41044e818)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:49.386714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:49.401680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98678b6c-d297-47f3-9ea0-ab277eb09f37 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:49.413943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c194c-d427-468b-b790-031017a216b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:49.414565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c194c-d427-468b-b790-031017a216b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:49.414853 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c194c-d427-468b-b790-031017a216b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:49.415134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c194c-d427-468b-b790-031017a216b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:49.415791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c194c-d427-468b-b790-031017a216b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:49.418391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c194c-d427-468b-b790-031017a216b6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:49.478296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 976/1966] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:49 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:04:49.483363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c194c-d427-468b-b790-031017a216b6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:49.505373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:49.565762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9affd09af02440e0843c47c41044e818', 'request_id': 'req-a4437db0-4d2b-48e2-b558-e167db649890'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:49.582134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c194c-d427-468b-b790-031017a216b6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:49.597116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9affd09af02440e0843c47c41044e818', 'request_id': 'req-a4437db0-4d2b-48e2-b558-e167db649890'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:49.608251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9affd09af02440e0843c47c41044e818', 'request_id': 'req-a4437db0-4d2b-48e2-b558-e167db649890'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:49.629561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] The token cache is being invalidate because project 9affd09af02440e0843c47c41044e818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:49.629863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:49.631156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:49.633385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 991/1967] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:49 2022] DELETE /identity/v3/projects/9affd09af02440e0843c47c41044e818 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:49.638256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:49.640254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:49.678881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7ea12-bddf-4087-87cf-91bc395d60e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:49.679421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ea12-bddf-4087-87cf-91bc395d60e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:49.679704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ea12-bddf-4087-87cf-91bc395d60e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:49.679985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7ea12-bddf-4087-87cf-91bc395d60e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:49.681543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7ea12-bddf-4087-87cf-91bc395d60e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:49.684795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7ea12-bddf-4087-87cf-91bc395d60e1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:49.728668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 977/1968] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:49 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:04:49.729747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7ea12-bddf-4087-87cf-91bc395d60e1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:49.731737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c0d7ea12-bddf-4087-87cf-91bc395d60e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:49.752179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7ea12-bddf-4087-87cf-91bc395d60e1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:49.759724 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c9bb0-c93d-46ea-b1b5-26cb5abb96d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:49.760552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c9bb0-c93d-46ea-b1b5-26cb5abb96d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:49.760945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c9bb0-c93d-46ea-b1b5-26cb5abb96d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:49.761795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c9bb0-c93d-46ea-b1b5-26cb5abb96d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:49.762538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c9bb0-c93d-46ea-b1b5-26cb5abb96d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:49.764321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c9bb0-c93d-46ea-b1b5-26cb5abb96d5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:49.775398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 978/1969] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:49.780716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c9bb0-c93d-46ea-b1b5-26cb5abb96d5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:49.791638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c9bb0-c93d-46ea-b1b5-26cb5abb96d5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:49.798164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e18aa-c010-4e47-b38a-7a18c660457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:49.798962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e18aa-c010-4e47-b38a-7a18c660457e admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:49.799043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4437db0-4d2b-48e2-b558-e167db649890 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:49.799318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e18aa-c010-4e47-b38a-7a18c660457e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:49.799599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e18aa-c010-4e47-b38a-7a18c660457e admin admin] PATH_INFO: `/v3/projects/24f40840a5e3409f87931c1f54b63db1/users/d6da7aaaafa04e93aa8cecf5103d71fd/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:49.806168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:49.806839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:49.807275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:49.807559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] PATH_INFO: `/v3/users/452ed832484d457590bc5a6e41ac4b0e` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:49.808770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452ed832484d457590bc5a6e41ac4b0e)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:49.810934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:49.818942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e18aa-c010-4e47-b38a-7a18c660457e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f40840a5e3409f87931c1f54b63db1, user_id=d6da7aaaafa04e93aa8cecf5103d71fd, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:49.821798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e18aa-c010-4e47-b38a-7a18c660457e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:49.845250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 979/1970] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:49 2022] PUT /identity/v3/projects/24f40840a5e3409f87931c1f54b63db1/users/d6da7aaaafa04e93aa8cecf5103d71fd/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:49.850415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e18aa-c010-4e47-b38a-7a18c660457e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:49.912917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452ed832484d457590bc5a6e41ac4b0e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:49.916362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452ed832484d457590bc5a6e41ac4b0e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:49.918770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:49.936012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452ed832484d457590bc5a6e41ac4b0e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:49.949481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452ed832484d457590bc5a6e41ac4b0e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:49.950241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452ed832484d457590bc5a6e41ac4b0e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:49.973954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e18aa-c010-4e47-b38a-7a18c660457e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:49.983695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819bc0f-94a0-4572-bbaa-2f8b11d22ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:49.984966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819bc0f-94a0-4572-bbaa-2f8b11d22ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:49.986132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819bc0f-94a0-4572-bbaa-2f8b11d22ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:49.986251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819bc0f-94a0-4572-bbaa-2f8b11d22ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:49.989777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 992/1971] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:49 2022] DELETE /identity/v3/users/452ed832484d457590bc5a6e41ac4b0e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:49.990161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819bc0f-94a0-4572-bbaa-2f8b11d22ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:49.990161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819bc0f-94a0-4572-bbaa-2f8b11d22ac3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:50.020197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 980/1972] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:50.028883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:50.031766 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:50.103639 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:50.147187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d2e18-3a50-4d9e-8007-b870d92f6671 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:50.152808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd18cf9-6b7c-4357-a9e6-05aa10e82f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:50.153482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18cf9-6b7c-4357-a9e6-05aa10e82f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:50.153767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18cf9-6b7c-4357-a9e6-05aa10e82f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:50.154051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18cf9-6b7c-4357-a9e6-05aa10e82f09 admin admin] PATH_INFO: `/v3/projects/24f40840a5e3409f87931c1f54b63db1/users/d6da7aaaafa04e93aa8cecf5103d71fd/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:50.157555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd18cf9-6b7c-4357-a9e6-05aa10e82f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f40840a5e3409f87931c1f54b63db1, user_id=d6da7aaaafa04e93aa8cecf5103d71fd, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:50.160322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd18cf9-6b7c-4357-a9e6-05aa10e82f09 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:50.173108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 993/1973] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:50 2022] PUT /identity/v3/projects/24f40840a5e3409f87931c1f54b63db1/users/d6da7aaaafa04e93aa8cecf5103d71fd/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:50.184438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d826ec-80bd-4886-8108-92c3a4003030 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:50.184677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d826ec-80bd-4886-8108-92c3a4003030 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:50.185545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d826ec-80bd-4886-8108-92c3a4003030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:50.219228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-10d826ec-80bd-4886-8108-92c3a4003030 None None] MFA Rules not processed for user `d6da7aaaafa04e93aa8cecf5103d71fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:50.221074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-10d826ec-80bd-4886-8108-92c3a4003030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:50.382976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 981/1974] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:50.421626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd18cf9-6b7c-4357-a9e6-05aa10e82f09 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:50.423402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-afd18cf9-6b7c-4357-a9e6-05aa10e82f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:50.503708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd18cf9-6b7c-4357-a9e6-05aa10e82f09 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:50.508246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b81d7-b482-4818-8fd2-ac5f25081362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:50.509364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b81d7-b482-4818-8fd2-ac5f25081362 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:50.509364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b81d7-b482-4818-8fd2-ac5f25081362 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:50.509653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b81d7-b482-4818-8fd2-ac5f25081362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:50.526999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b81d7-b482-4818-8fd2-ac5f25081362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:50.528969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b81d7-b482-4818-8fd2-ac5f25081362 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:50.571559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 994/1975] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:50.601465 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d826ec-80bd-4886-8108-92c3a4003030 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:50.603241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-10d826ec-80bd-4886-8108-92c3a4003030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:50.757559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d826ec-80bd-4886-8108-92c3a4003030 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:50.764448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:50.765148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:50.765428 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:50.765767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] PATH_INFO: `/v3/projects/bf2ca1d898024e73b41616134db402d6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:50.767056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2ca1d898024e73b41616134db402d6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:50.768999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:50.855669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2ca1d898024e73b41616134db402d6', 'request_id': 'req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:50.863778 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2ca1d898024e73b41616134db402d6', 'request_id': 'req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:50.870919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:50.886997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2ca1d898024e73b41616134db402d6', 'request_id': 'req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:50.909011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] The token cache is being invalidate because project bf2ca1d898024e73b41616134db402d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:50.909546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:50.913230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b758bcc0-7890-412f-b6eb-3bd70b0a23b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:50.920511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 982/1976] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:50 2022] DELETE /identity/v3/projects/bf2ca1d898024e73b41616134db402d6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:50.922507 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f0d7-bb8b-4b02-9004-934097a3fb04 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:50.922797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f0d7-bb8b-4b02-9004-934097a3fb04 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:50.923073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f0d7-bb8b-4b02-9004-934097a3fb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:50.946189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-58d6f0d7-bb8b-4b02-9004-934097a3fb04 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:50.947488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-58d6f0d7-bb8b-4b02-9004-934097a3fb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:51.041427 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 995/1977] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:51.051147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a5698-a20c-4100-a850-75683ea801d1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.051470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a5698-a20c-4100-a850-75683ea801d1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.051703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a5698-a20c-4100-a850-75683ea801d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.079909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4c0a5698-a20c-4100-a850-75683ea801d1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:51.081178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4c0a5698-a20c-4100-a850-75683ea801d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:51.094299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 983/1978] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:51.095781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f0d7-bb8b-4b02-9004-934097a3fb04 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:51.106567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f0d7-bb8b-4b02-9004-934097a3fb04 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:51.112387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626cef7-85c9-4a12-a15c-521519d0883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:51.113044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626cef7-85c9-4a12-a15c-521519d0883e admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.113328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626cef7-85c9-4a12-a15c-521519d0883e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.113613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626cef7-85c9-4a12-a15c-521519d0883e admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.114302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626cef7-85c9-4a12-a15c-521519d0883e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:51.114604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626cef7-85c9-4a12-a15c-521519d0883e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:51.116217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626cef7-85c9-4a12-a15c-521519d0883e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:51.128550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 996/1979] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:51.133000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a5698-a20c-4100-a850-75683ea801d1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:51.142261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a5698-a20c-4100-a850-75683ea801d1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:51.146825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97245ea6-1495-41c2-a46b-8d3de9fcadba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:51.147441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97245ea6-1495-41c2-a46b-8d3de9fcadba admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.147717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97245ea6-1495-41c2-a46b-8d3de9fcadba admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.147995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97245ea6-1495-41c2-a46b-8d3de9fcadba admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.148651 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97245ea6-1495-41c2-a46b-8d3de9fcadba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:51.150533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97245ea6-1495-41c2-a46b-8d3de9fcadba admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:51.183615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 984/1980] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:51 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:51.187825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626cef7-85c9-4a12-a15c-521519d0883e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:51.195403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97245ea6-1495-41c2-a46b-8d3de9fcadba admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:51.197143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-97245ea6-1495-41c2-a46b-8d3de9fcadba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:51.199085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626cef7-85c9-4a12-a15c-521519d0883e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:51.254469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:51.262709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f93a7-5d2a-4c5e-91bd-a441d66cde62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:51.263444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f93a7-5d2a-4c5e-91bd-a441d66cde62 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.263983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f93a7-5d2a-4c5e-91bd-a441d66cde62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.264277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f93a7-5d2a-4c5e-91bd-a441d66cde62 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.264948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f93a7-5d2a-4c5e-91bd-a441d66cde62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:51.266943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f93a7-5d2a-4c5e-91bd-a441d66cde62 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:51.267694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97245ea6-1495-41c2-a46b-8d3de9fcadba admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:51.272737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:51.273524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.273829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.274103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] PATH_INFO: `/v3/users/8fdb58cce4944cc88e432ff8bcf2d50f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.275532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdb58cce4944cc88e432ff8bcf2d50f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:51.277682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:51.292239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 997/1981] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:51 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:04:51.297166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f93a7-5d2a-4c5e-91bd-a441d66cde62 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:51.308188 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f93a7-5d2a-4c5e-91bd-a441d66cde62 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:51.313298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554080b-7387-4610-b0af-6463e047a5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:51.313918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554080b-7387-4610-b0af-6463e047a5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.314196 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554080b-7387-4610-b0af-6463e047a5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.314463 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554080b-7387-4610-b0af-6463e047a5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.315105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554080b-7387-4610-b0af-6463e047a5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:51.316720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554080b-7387-4610-b0af-6463e047a5c3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:51.330190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 998/1982] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:51.334326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554080b-7387-4610-b0af-6463e047a5c3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:51.343689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdb58cce4944cc88e432ff8bcf2d50f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:51.345012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554080b-7387-4610-b0af-6463e047a5c3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:51.350414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8590cc8-1b09-4cd7-847b-605e166c237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:51.351156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8590cc8-1b09-4cd7-847b-605e166c237d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.351525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8590cc8-1b09-4cd7-847b-605e166c237d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.351735 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8590cc8-1b09-4cd7-847b-605e166c237d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.353341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8590cc8-1b09-4cd7-847b-605e166c237d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:51.354485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8590cc8-1b09-4cd7-847b-605e166c237d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:51.355055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdb58cce4944cc88e432ff8bcf2d50f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:51.356995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdb58cce4944cc88e432ff8bcf2d50f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:51.358274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdb58cce4944cc88e432ff8bcf2d50f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:51.366767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 999/1983] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:04:51.366922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-7faf462a-81b4-4ff4-b9c7-1cba3b294089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdb58cce4944cc88e432ff8bcf2d50f'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:51.374744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8590cc8-1b09-4cd7-847b-605e166c237d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:51.376547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c8590cc8-1b09-4cd7-847b-605e166c237d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:51.392315 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8590cc8-1b09-4cd7-847b-605e166c237d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:51.393204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 985/1984] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:51 2022] DELETE /identity/v3/users/8fdb58cce4944cc88e432ff8bcf2d50f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:51.397730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b682f-9a61-456d-b8a4-3b92dac514ad None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.398192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b682f-9a61-456d-b8a4-3b92dac514ad None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.398483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b682f-9a61-456d-b8a4-3b92dac514ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.424976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-138b682f-9a61-456d-b8a4-3b92dac514ad None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:51.427088 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-138b682f-9a61-456d-b8a4-3b92dac514ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:51.466408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:51.489881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84e88d-ecb1-4292-8595-aaea2a455d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:51.490678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84e88d-ecb1-4292-8595-aaea2a455d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.490867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84e88d-ecb1-4292-8595-aaea2a455d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.491136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84e88d-ecb1-4292-8595-aaea2a455d4e admin admin] PATH_INFO: `/v3/projects/1fd6b244110f4c5a925d56edf07864e7/users/fe3e035d284a4756b4061a3250903a52/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.506953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 986/1985] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:51.518018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84e88d-ecb1-4292-8595-aaea2a455d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd6b244110f4c5a925d56edf07864e7, user_id=fe3e035d284a4756b4061a3250903a52, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:51.521182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84e88d-ecb1-4292-8595-aaea2a455d4e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:51.528014 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b682f-9a61-456d-b8a4-3b92dac514ad None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:51.531566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-138b682f-9a61-456d-b8a4-3b92dac514ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:51.536042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1000/1986] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:51 2022] PUT /identity/v3/projects/1fd6b244110f4c5a925d56edf07864e7/users/fe3e035d284a4756b4061a3250903a52/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:51.546612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee0b85-d3c1-45e4-8a71-9866eab31aca None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.547086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee0b85-d3c1-45e4-8a71-9866eab31aca None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.547364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee0b85-d3c1-45e4-8a71-9866eab31aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.588177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3dee0b85-d3c1-45e4-8a71-9866eab31aca None None] MFA Rules not processed for user `fe3e035d284a4756b4061a3250903a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:51.589618 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3dee0b85-d3c1-45e4-8a71-9866eab31aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:51.621051 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b682f-9a61-456d-b8a4-3b92dac514ad None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:51.683308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d3002-e559-4d8a-b0d1-76e71d834e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:51.684557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d3002-e559-4d8a-b0d1-76e71d834e93 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.685010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d3002-e559-4d8a-b0d1-76e71d834e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.685387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d3002-e559-4d8a-b0d1-76e71d834e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.711112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1001/1987] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:51.717286 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee0b85-d3c1-45e4-8a71-9866eab31aca None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:51.817814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:51.839941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d3002-e559-4d8a-b0d1-76e71d834e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:51.842194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d3002-e559-4d8a-b0d1-76e71d834e93 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:51.871311 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee0b85-d3c1-45e4-8a71-9866eab31aca None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:51.880018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 987/1988] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:51.887078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ca0b3-f74a-4f05-817f-55d44a95c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:51.889372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ca0b3-f74a-4f05-817f-55d44a95c3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:51.889747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ca0b3-f74a-4f05-817f-55d44a95c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:51.890086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ca0b3-f74a-4f05-817f-55d44a95c3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:51.893676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ca0b3-f74a-4f05-817f-55d44a95c3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:51.893676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ca0b3-f74a-4f05-817f-55d44a95c3e6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:51.960549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1002/1989] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:51 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:51.961518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d3002-e559-4d8a-b0d1-76e71d834e93 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:51.977680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d3002-e559-4d8a-b0d1-76e71d834e93 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:52.082080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:52.126694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc80ec5-5298-4210-8bfc-2f7655f5fe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:52.128076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc80ec5-5298-4210-8bfc-2f7655f5fe82 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.128612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc80ec5-5298-4210-8bfc-2f7655f5fe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.129952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc80ec5-5298-4210-8bfc-2f7655f5fe82 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.130835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc80ec5-5298-4210-8bfc-2f7655f5fe82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:52.135073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc80ec5-5298-4210-8bfc-2f7655f5fe82 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:52.172223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 988/1990] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:51 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:04:52.176630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ca0b3-f74a-4f05-817f-55d44a95c3e6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:52.188866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ca0b3-f74a-4f05-817f-55d44a95c3e6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:52.203406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8045-9194-4f2a-8deb-7198aed923e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:52.203406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8045-9194-4f2a-8deb-7198aed923e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.203406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8045-9194-4f2a-8deb-7198aed923e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.203406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8045-9194-4f2a-8deb-7198aed923e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.204276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd8045-9194-4f2a-8deb-7198aed923e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:52.206085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd8045-9194-4f2a-8deb-7198aed923e4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:52.221862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1003/1991] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:52.226133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc80ec5-5298-4210-8bfc-2f7655f5fe82 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:52.255872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc80ec5-5298-4210-8bfc-2f7655f5fe82 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:52.263254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3db752-c1e7-4e18-8f03-ad20624ae7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:52.264545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db752-c1e7-4e18-8f03-ad20624ae7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.265057 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db752-c1e7-4e18-8f03-ad20624ae7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.265349 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3db752-c1e7-4e18-8f03-ad20624ae7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.266008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3db752-c1e7-4e18-8f03-ad20624ae7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:52.269369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3db752-c1e7-4e18-8f03-ad20624ae7c6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:52.284499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 989/1992] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:52.286127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8045-9194-4f2a-8deb-7198aed923e4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:52.300488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8045-9194-4f2a-8deb-7198aed923e4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:52.308172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472f057-4e3d-4976-8bc9-3548f0366fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:52.309279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472f057-4e3d-4976-8bc9-3548f0366fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.309710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472f057-4e3d-4976-8bc9-3548f0366fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.310129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472f057-4e3d-4976-8bc9-3548f0366fa5 admin admin] PATH_INFO: `/v3/projects/a10533340acc4ab585c0f07ed39cb860/users/d6691a26c28b44b09d5efc415696b138/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.333383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472f057-4e3d-4976-8bc9-3548f0366fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a10533340acc4ab585c0f07ed39cb860, user_id=d6691a26c28b44b09d5efc415696b138, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:52.337394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472f057-4e3d-4976-8bc9-3548f0366fa5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:52.353808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1004/1993] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:52 2022] PUT /identity/v3/projects/a10533340acc4ab585c0f07ed39cb860/users/d6691a26c28b44b09d5efc415696b138/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:52.367849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a3364-a75c-4da7-b64e-5ac80c1081fb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.368209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a3364-a75c-4da7-b64e-5ac80c1081fb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.368588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a3364-a75c-4da7-b64e-5ac80c1081fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.392255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472f057-4e3d-4976-8bc9-3548f0366fa5 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:52.394523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9472f057-4e3d-4976-8bc9-3548f0366fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:52.400071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3b5a3364-a75c-4da7-b64e-5ac80c1081fb None None] MFA Rules not processed for user `d6691a26c28b44b09d5efc415696b138`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:52.401569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3b5a3364-a75c-4da7-b64e-5ac80c1081fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:52.481792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472f057-4e3d-4976-8bc9-3548f0366fa5 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:52.487456 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:52.488677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.488677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.488887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] PATH_INFO: `/v3/projects/5d10b16104084359b524daeb688269e3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.490131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d10b16104084359b524daeb688269e3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:52.492641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:52.506023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 990/1994] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:52.510593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a3364-a75c-4da7-b64e-5ac80c1081fb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:52.522438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a3364-a75c-4da7-b64e-5ac80c1081fb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:52.527668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ad6fb-b7de-4b36-a79c-62ed09afc0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:52.528623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ad6fb-b7de-4b36-a79c-62ed09afc0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.528814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ad6fb-b7de-4b36-a79c-62ed09afc0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.529622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ad6fb-b7de-4b36-a79c-62ed09afc0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.530394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ad6fb-b7de-4b36-a79c-62ed09afc0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:52.532346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ad6fb-b7de-4b36-a79c-62ed09afc0e5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:52.547798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d10b16104084359b524daeb688269e3', 'request_id': 'req-840708f1-c172-4692-b670-ec9c4699b703'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:52.563018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d10b16104084359b524daeb688269e3', 'request_id': 'req-840708f1-c172-4692-b670-ec9c4699b703'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:52.571149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 991/1995] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:52 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:52.571987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d10b16104084359b524daeb688269e3', 'request_id': 'req-840708f1-c172-4692-b670-ec9c4699b703'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:52.575323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ad6fb-b7de-4b36-a79c-62ed09afc0e5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:52.588291 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] The token cache is being invalidate because project 5d10b16104084359b524daeb688269e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:52.588881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:52.589610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:52.591395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1005/1996] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:52 2022] DELETE /identity/v3/projects/5d10b16104084359b524daeb688269e3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:52.595645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:52.597812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:52.622461 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:52.658267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ad6fb-b7de-4b36-a79c-62ed09afc0e5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:52.662879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dbaf8-bfdd-4b87-9d96-a10a77370a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:52.663495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dbaf8-bfdd-4b87-9d96-a10a77370a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.663776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dbaf8-bfdd-4b87-9d96-a10a77370a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.664050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dbaf8-bfdd-4b87-9d96-a10a77370a38 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.664733 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dbaf8-bfdd-4b87-9d96-a10a77370a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:52.666671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dbaf8-bfdd-4b87-9d96-a10a77370a38 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:52.679751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840708f1-c172-4692-b670-ec9c4699b703 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:52.685743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:52.687561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.687561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.687561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] PATH_INFO: `/v3/users/d6da7aaaafa04e93aa8cecf5103d71fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.688282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6da7aaaafa04e93aa8cecf5103d71fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:52.690492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:52.693656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 992/1997] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:52 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:04:52.697348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dbaf8-bfdd-4b87-9d96-a10a77370a38 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:52.699240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6f9dbaf8-bfdd-4b87-9d96-a10a77370a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:52.713209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dbaf8-bfdd-4b87-9d96-a10a77370a38 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:52.720827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781fe74-ce87-4753-8c37-e258996de5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:52.721780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781fe74-ce87-4753-8c37-e258996de5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.722129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781fe74-ce87-4753-8c37-e258996de5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.722469 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781fe74-ce87-4753-8c37-e258996de5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.723242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781fe74-ce87-4753-8c37-e258996de5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:52.725035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781fe74-ce87-4753-8c37-e258996de5ca admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:52.740756 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 993/1998] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:52.748253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781fe74-ce87-4753-8c37-e258996de5ca admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:52.759106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781fe74-ce87-4753-8c37-e258996de5ca admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:52.764215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321ea0b-2d7b-445c-a3bb-ee750a058117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:52.765013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321ea0b-2d7b-445c-a3bb-ee750a058117 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:52.765361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321ea0b-2d7b-445c-a3bb-ee750a058117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:52.765708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321ea0b-2d7b-445c-a3bb-ee750a058117 admin admin] PATH_INFO: `/v3/projects/92aacfa023514957859ccd72f36e3ff9/users/e1faddff30944d368d3df96c93803be7/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:52.767480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6da7aaaafa04e93aa8cecf5103d71fd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:52.768154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6da7aaaafa04e93aa8cecf5103d71fd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:52.768281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:52.782408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6da7aaaafa04e93aa8cecf5103d71fd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:52.786226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321ea0b-2d7b-445c-a3bb-ee750a058117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92aacfa023514957859ccd72f36e3ff9, user_id=e1faddff30944d368d3df96c93803be7, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:52.789145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321ea0b-2d7b-445c-a3bb-ee750a058117 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:52.790150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6da7aaaafa04e93aa8cecf5103d71fd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:52.790869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6da7aaaafa04e93aa8cecf5103d71fd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:52.803722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 994/1999] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:52 2022] PUT /identity/v3/projects/92aacfa023514957859ccd72f36e3ff9/users/e1faddff30944d368d3df96c93803be7/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:52.807837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321ea0b-2d7b-445c-a3bb-ee750a058117 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:52.808408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1006/2000] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:52 2022] DELETE /identity/v3/users/d6da7aaaafa04e93aa8cecf5103d71fd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:52.810133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0321ea0b-2d7b-445c-a3bb-ee750a058117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:52.933174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321ea0b-2d7b-445c-a3bb-ee750a058117 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:53.062647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543de9d2-4438-4db3-8639-d33df98487d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:53.063617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de9d2-4438-4db3-8639-d33df98487d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:53.064156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de9d2-4438-4db3-8639-d33df98487d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:53.064625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de9d2-4438-4db3-8639-d33df98487d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:53.065668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543de9d2-4438-4db3-8639-d33df98487d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:53.068129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543de9d2-4438-4db3-8639-d33df98487d8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:53.080499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 995/2001] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:04:53.084574 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:53.099988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06125796-1f1e-4349-83d0-39ba779422c1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:53.107244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0f042-4e45-4a39-b124-f657f4030d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:53.108042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f042-4e45-4a39-b124-f657f4030d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:53.108530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f042-4e45-4a39-b124-f657f4030d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:53.108913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f042-4e45-4a39-b124-f657f4030d1a admin admin] PATH_INFO: `/v3/projects/92aacfa023514957859ccd72f36e3ff9/users/e1faddff30944d368d3df96c93803be7/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:53.111661 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0f042-4e45-4a39-b124-f657f4030d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=92aacfa023514957859ccd72f36e3ff9, user_id=e1faddff30944d368d3df96c93803be7, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:53.114072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0f042-4e45-4a39-b124-f657f4030d1a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:53.128257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1007/2002] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:53 2022] PUT /identity/v3/projects/92aacfa023514957859ccd72f36e3ff9/users/e1faddff30944d368d3df96c93803be7/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:53.140174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58f61-0876-4997-bf4b-4678eb5360df None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:53.143563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58f61-0876-4997-bf4b-4678eb5360df None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:53.144078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58f61-0876-4997-bf4b-4678eb5360df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:53.181445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f4e58f61-0876-4997-bf4b-4678eb5360df None None] MFA Rules not processed for user `e1faddff30944d368d3df96c93803be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:53.182775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f4e58f61-0876-4997-bf4b-4678eb5360df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:53.283890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0f042-4e45-4a39-b124-f657f4030d1a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:53.285735 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a6c0f042-4e45-4a39-b124-f657f4030d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:53.339886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 996/2003] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:53.398227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e58f61-0876-4997-bf4b-4678eb5360df None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:53.403230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f4e58f61-0876-4997-bf4b-4678eb5360df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:53.418119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0f042-4e45-4a39-b124-f657f4030d1a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:53.424447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:53.425314 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:53.425693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:53.426050 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:53.426334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] PATH_INFO: `/v3/projects/24f40840a5e3409f87931c1f54b63db1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:53.427609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f40840a5e3409f87931c1f54b63db1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:53.430296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:53.476835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:53.515171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f40840a5e3409f87931c1f54b63db1', 'request_id': 'req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:53.527600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f40840a5e3409f87931c1f54b63db1', 'request_id': 'req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:53.537018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e58f61-0876-4997-bf4b-4678eb5360df None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:53.537938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f40840a5e3409f87931c1f54b63db1', 'request_id': 'req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:53.553101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] The token cache is being invalidate because project 24f40840a5e3409f87931c1f54b63db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:53.553800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:53.554878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-67c9cc7b-c12f-431a-ac2d-629e6a9cddd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:53.558356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1008/2004] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:53 2022] DELETE /identity/v3/projects/24f40840a5e3409f87931c1f54b63db1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:53.564565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41252-4220-4018-9331-dbb71eca6ac4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:53.564861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41252-4220-4018-9331-dbb71eca6ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:53.565186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd41252-4220-4018-9331-dbb71eca6ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:53.600018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-dbd41252-4220-4018-9331-dbb71eca6ac4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:53.601399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dbd41252-4220-4018-9331-dbb71eca6ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:53.617537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533d7c9-8b55-4a08-a046-fdaa4ef67493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:53.618285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533d7c9-8b55-4a08-a046-fdaa4ef67493 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:53.618688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533d7c9-8b55-4a08-a046-fdaa4ef67493 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:53.618976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533d7c9-8b55-4a08-a046-fdaa4ef67493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:53.624854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e533d7c9-8b55-4a08-a046-fdaa4ef67493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:53.707516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1009/2005] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:53.709710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7444-4d5f-4f9d-a0c9-d0986a1e5996 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:53.710032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7444-4d5f-4f9d-a0c9-d0986a1e5996 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:53.710278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc7444-4d5f-4f9d-a0c9-d0986a1e5996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:53.714779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533d7c9-8b55-4a08-a046-fdaa4ef67493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:53.716368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533d7c9-8b55-4a08-a046-fdaa4ef67493 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:53.745248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 997/2006] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:53.767189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-00cc7444-4d5f-4f9d-a0c9-d0986a1e5996 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:53.769087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-00cc7444-4d5f-4f9d-a0c9-d0986a1e5996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:53.783351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1010/2007] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:53.784351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533d7c9-8b55-4a08-a046-fdaa4ef67493 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:53.800016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533d7c9-8b55-4a08-a046-fdaa4ef67493 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:53.811147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0827c8a-dffb-4efd-bb10-1daedb3087de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:53.813821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0827c8a-dffb-4efd-bb10-1daedb3087de admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:53.814117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0827c8a-dffb-4efd-bb10-1daedb3087de admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:53.814400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0827c8a-dffb-4efd-bb10-1daedb3087de admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:53.815397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0827c8a-dffb-4efd-bb10-1daedb3087de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:53.815787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0827c8a-dffb-4efd-bb10-1daedb3087de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:53.818083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0827c8a-dffb-4efd-bb10-1daedb3087de admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:53.839884 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 998/2008] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 17:04:53.844884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc7444-4d5f-4f9d-a0c9-d0986a1e5996 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:53.858540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc7444-4d5f-4f9d-a0c9-d0986a1e5996 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:53.875812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b754f-59d8-4eb7-93ae-8cbe9ee15b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:53.876936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b754f-59d8-4eb7-93ae-8cbe9ee15b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:53.877223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b754f-59d8-4eb7-93ae-8cbe9ee15b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:53.877496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b754f-59d8-4eb7-93ae-8cbe9ee15b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:53.878199 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b754f-59d8-4eb7-93ae-8cbe9ee15b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:53.880433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b754f-59d8-4eb7-93ae-8cbe9ee15b0b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:53.894512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0827c8a-dffb-4efd-bb10-1daedb3087de admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:53.896338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d0827c8a-dffb-4efd-bb10-1daedb3087de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:53.914094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0827c8a-dffb-4efd-bb10-1daedb3087de admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:53.928437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56576a-0395-4b45-879c-91510f248674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:53.929277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1011/2009] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:53 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:53.930263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b754f-59d8-4eb7-93ae-8cbe9ee15b0b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:53.931126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56576a-0395-4b45-879c-91510f248674 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:53.931406 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56576a-0395-4b45-879c-91510f248674 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:53.931711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56576a-0395-4b45-879c-91510f248674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:53.935365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dd56576a-0395-4b45-879c-91510f248674 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:54.024492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56576a-0395-4b45-879c-91510f248674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:54.026736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56576a-0395-4b45-879c-91510f248674 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:54.033072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b754f-59d8-4eb7-93ae-8cbe9ee15b0b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:54.037475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddf830-42fa-4728-a3cc-0a74d14d38ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:54.038330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddf830-42fa-4728-a3cc-0a74d14d38ee admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.038760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddf830-42fa-4728-a3cc-0a74d14d38ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.039222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddf830-42fa-4728-a3cc-0a74d14d38ee admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.039967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddf830-42fa-4728-a3cc-0a74d14d38ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:54.041159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 999/2010] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:54.042885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddf830-42fa-4728-a3cc-0a74d14d38ee admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:54.077135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1012/2011] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:53 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:54.081819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56576a-0395-4b45-879c-91510f248674 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:54.087900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:54.096636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56576a-0395-4b45-879c-91510f248674 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:54.102744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959d8c0-72ee-4949-afdc-ae87aeaa7656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:54.103669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959d8c0-72ee-4949-afdc-ae87aeaa7656 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.103953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959d8c0-72ee-4949-afdc-ae87aeaa7656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.104226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959d8c0-72ee-4949-afdc-ae87aeaa7656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.105032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959d8c0-72ee-4949-afdc-ae87aeaa7656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:54.106742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959d8c0-72ee-4949-afdc-ae87aeaa7656 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:54.129863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1000/2012] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:54.133324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddf830-42fa-4728-a3cc-0a74d14d38ee admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:54.145103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddf830-42fa-4728-a3cc-0a74d14d38ee admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:54.158348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738609fa-d581-4488-bba7-a1201eed6d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:54.159024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738609fa-d581-4488-bba7-a1201eed6d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.159341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738609fa-d581-4488-bba7-a1201eed6d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.160842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738609fa-d581-4488-bba7-a1201eed6d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.161620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738609fa-d581-4488-bba7-a1201eed6d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:54.163371 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738609fa-d581-4488-bba7-a1201eed6d67 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:54.175350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1013/2013] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:54.179563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959d8c0-72ee-4949-afdc-ae87aeaa7656 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:54.190879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959d8c0-72ee-4949-afdc-ae87aeaa7656 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:54.197335 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126f3a1-d76d-4c28-9ade-7a36050b36e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:54.198254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f3a1-d76d-4c28-9ade-7a36050b36e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.198606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f3a1-d76d-4c28-9ade-7a36050b36e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.198954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f3a1-d76d-4c28-9ade-7a36050b36e0 admin admin] PATH_INFO: `/v3/projects/ae6d44662d074c8e8d7fcc7674b0e85a/users/763cbd51b7ad4a3ab6eed63b4dbbb28a/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.219337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f3a1-d76d-4c28-9ade-7a36050b36e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6d44662d074c8e8d7fcc7674b0e85a, user_id=763cbd51b7ad4a3ab6eed63b4dbbb28a, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:54.222254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f3a1-d76d-4c28-9ade-7a36050b36e0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:54.241397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1001/2014] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:54 2022] PUT /identity/v3/projects/ae6d44662d074c8e8d7fcc7674b0e85a/users/763cbd51b7ad4a3ab6eed63b4dbbb28a/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:54.252837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a764-9355-4f8d-9419-f694b22c9c0d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.253132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a764-9355-4f8d-9419-f694b22c9c0d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.253416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a764-9355-4f8d-9419-f694b22c9c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.261615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:54.283869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e118a764-9355-4f8d-9419-f694b22c9c0d None None] MFA Rules not processed for user `763cbd51b7ad4a3ab6eed63b4dbbb28a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:54.285468 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e118a764-9355-4f8d-9419-f694b22c9c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:54.357249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1014/2015] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:54.362045 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126f3a1-d76d-4c28-9ade-7a36050b36e0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:54.438659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126f3a1-d76d-4c28-9ade-7a36050b36e0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:54.444836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca3157-040c-40b9-b388-639e44f76918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:54.445029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca3157-040c-40b9-b388-639e44f76918 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.445394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca3157-040c-40b9-b388-639e44f76918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.445740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca3157-040c-40b9-b388-639e44f76918 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.446504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca3157-040c-40b9-b388-639e44f76918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:54.448557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca3157-040c-40b9-b388-639e44f76918 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:54.481454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1002/2016] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:54 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:04:54.486495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118a764-9355-4f8d-9419-f694b22c9c0d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:54.501613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118a764-9355-4f8d-9419-f694b22c9c0d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:54.567969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316239c-3801-4300-8fd2-a81e6591ccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:54.568694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316239c-3801-4300-8fd2-a81e6591ccf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.568886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316239c-3801-4300-8fd2-a81e6591ccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.569160 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316239c-3801-4300-8fd2-a81e6591ccf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.569843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316239c-3801-4300-8fd2-a81e6591ccf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:54.571775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316239c-3801-4300-8fd2-a81e6591ccf0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:54.592199 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1015/2017] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:54 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:54.596272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca3157-040c-40b9-b388-639e44f76918 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:54.606792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca3157-040c-40b9-b388-639e44f76918 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:54.611939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e3668-48c2-4ab0-98ce-a1017121fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:54.612585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e3668-48c2-4ab0-98ce-a1017121fb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.612870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e3668-48c2-4ab0-98ce-a1017121fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.613147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e3668-48c2-4ab0-98ce-a1017121fb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.613785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e3668-48c2-4ab0-98ce-a1017121fb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:54.615370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e3668-48c2-4ab0-98ce-a1017121fb09 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:54.627409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1003/2018] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:54.631268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316239c-3801-4300-8fd2-a81e6591ccf0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:54.641570 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316239c-3801-4300-8fd2-a81e6591ccf0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:54.646248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030d0e-3d85-4ac9-b899-01d2a6c11cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:54.647596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030d0e-3d85-4ac9-b899-01d2a6c11cca admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.648515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030d0e-3d85-4ac9-b899-01d2a6c11cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.648846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030d0e-3d85-4ac9-b899-01d2a6c11cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.649551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41030d0e-3d85-4ac9-b899-01d2a6c11cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:54.651672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41030d0e-3d85-4ac9-b899-01d2a6c11cca admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:54.661524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1016/2019] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:54.665843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e3668-48c2-4ab0-98ce-a1017121fb09 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:54.677847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e3668-48c2-4ab0-98ce-a1017121fb09 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:54.682698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d041-01f9-4cf1-873b-0bf5a7c72738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:54.683370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d041-01f9-4cf1-873b-0bf5a7c72738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.683654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d041-01f9-4cf1-873b-0bf5a7c72738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.683930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d041-01f9-4cf1-873b-0bf5a7c72738 admin admin] PATH_INFO: `/v3/projects/142b6a3e808942fd8cc867198ecce482/users/a34e6e6230d143c68f235e5fdf13e41a/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.700018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838d041-01f9-4cf1-873b-0bf5a7c72738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142b6a3e808942fd8cc867198ecce482, user_id=a34e6e6230d143c68f235e5fdf13e41a, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:54.703954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838d041-01f9-4cf1-873b-0bf5a7c72738 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:54.719559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1004/2020] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:54 2022] PUT /identity/v3/projects/142b6a3e808942fd8cc867198ecce482/users/a34e6e6230d143c68f235e5fdf13e41a/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:54.731414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0acd5-cc1c-4ceb-9c04-58095e468672 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:54.732952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0acd5-cc1c-4ceb-9c04-58095e468672 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:54.733241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0acd5-cc1c-4ceb-9c04-58095e468672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:54.764497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-16d0acd5-cc1c-4ceb-9c04-58095e468672 None None] MFA Rules not processed for user `a34e6e6230d143c68f235e5fdf13e41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:54.765767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-16d0acd5-cc1c-4ceb-9c04-58095e468672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:54.863230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1017/2021] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:54.864661 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d041-01f9-4cf1-873b-0bf5a7c72738 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:55.011604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d041-01f9-4cf1-873b-0bf5a7c72738 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:55.037935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaa263-caa4-4f52-a3a9-ccb48b4dd1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:55.038931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaa263-caa4-4f52-a3a9-ccb48b4dd1ed admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:55.039319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaa263-caa4-4f52-a3a9-ccb48b4dd1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:55.039760 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaa263-caa4-4f52-a3a9-ccb48b4dd1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:55.040691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbaa263-caa4-4f52-a3a9-ccb48b4dd1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:55.043237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbaa263-caa4-4f52-a3a9-ccb48b4dd1ed admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:55.105549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1005/2022] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:54 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:04:55.110432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0acd5-cc1c-4ceb-9c04-58095e468672 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:55.115958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:55.127740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0acd5-cc1c-4ceb-9c04-58095e468672 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:55.215085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03184e00-5099-45dc-8d3d-bbadb6c8891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:55.215754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03184e00-5099-45dc-8d3d-bbadb6c8891d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:55.216198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03184e00-5099-45dc-8d3d-bbadb6c8891d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:55.216553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03184e00-5099-45dc-8d3d-bbadb6c8891d admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:55.217459 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03184e00-5099-45dc-8d3d-bbadb6c8891d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:55.219931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03184e00-5099-45dc-8d3d-bbadb6c8891d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:55.245957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1018/2023] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:55 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:04:55.257075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaa263-caa4-4f52-a3a9-ccb48b4dd1ed admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:55.269071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:55.280540 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaa263-caa4-4f52-a3a9-ccb48b4dd1ed admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:55.305360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd809e54-941a-4737-a638-c5dd8a192a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:55.308253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd809e54-941a-4737-a638-c5dd8a192a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:55.308253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd809e54-941a-4737-a638-c5dd8a192a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:55.308253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd809e54-941a-4737-a638-c5dd8a192a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:55.311562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd809e54-941a-4737-a638-c5dd8a192a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:55.319398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd809e54-941a-4737-a638-c5dd8a192a6c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:55.377297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1006/2024] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:55.377417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03184e00-5099-45dc-8d3d-bbadb6c8891d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:55.405107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03184e00-5099-45dc-8d3d-bbadb6c8891d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:55.413901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31906ee-79cb-4451-baaa-575a6b930a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:55.414470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31906ee-79cb-4451-baaa-575a6b930a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:55.414785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31906ee-79cb-4451-baaa-575a6b930a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:55.415028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31906ee-79cb-4451-baaa-575a6b930a60 admin admin] PATH_INFO: `/v3/projects/fa5e3fde19794544b0fea9e8a28f915f/users/67d682d50c1741c980b22526fd1ecdc0/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:55.434951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31906ee-79cb-4451-baaa-575a6b930a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5e3fde19794544b0fea9e8a28f915f, user_id=67d682d50c1741c980b22526fd1ecdc0, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:55.453449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31906ee-79cb-4451-baaa-575a6b930a60 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:55.478316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1019/2025] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:55 2022] PUT /identity/v3/projects/fa5e3fde19794544b0fea9e8a28f915f/users/67d682d50c1741c980b22526fd1ecdc0/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:55.483523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd809e54-941a-4737-a638-c5dd8a192a6c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:55.504712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd809e54-941a-4737-a638-c5dd8a192a6c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:55.542065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31906ee-79cb-4451-baaa-575a6b930a60 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:55.545620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b31906ee-79cb-4451-baaa-575a6b930a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:55.610181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe854d0-448c-405c-b7c1-45ff742a6122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:55.610951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe854d0-448c-405c-b7c1-45ff742a6122 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:55.611364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe854d0-448c-405c-b7c1-45ff742a6122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:55.611648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe854d0-448c-405c-b7c1-45ff742a6122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:55.612588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe854d0-448c-405c-b7c1-45ff742a6122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:55.624826 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe854d0-448c-405c-b7c1-45ff742a6122 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:55.642523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1007/2026] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:04:55.643611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe854d0-448c-405c-b7c1-45ff742a6122 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:55.658726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe854d0-448c-405c-b7c1-45ff742a6122 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:55.682531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a060309-e1b6-47c1-9ee5-7bdbcf00b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:55.683352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a060309-e1b6-47c1-9ee5-7bdbcf00b8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:55.684135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a060309-e1b6-47c1-9ee5-7bdbcf00b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:55.684425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a060309-e1b6-47c1-9ee5-7bdbcf00b8a5 admin admin] PATH_INFO: `/v3/projects/fa5e3fde19794544b0fea9e8a28f915f/users/67d682d50c1741c980b22526fd1ecdc0/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:55.687002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a060309-e1b6-47c1-9ee5-7bdbcf00b8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5e3fde19794544b0fea9e8a28f915f, user_id=67d682d50c1741c980b22526fd1ecdc0, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:55.691195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a060309-e1b6-47c1-9ee5-7bdbcf00b8a5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:55.714018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1008/2027] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:04:55 2022] PUT /identity/v3/projects/fa5e3fde19794544b0fea9e8a28f915f/users/67d682d50c1741c980b22526fd1ecdc0/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:55.724527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31906ee-79cb-4451-baaa-575a6b930a60 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:55.725092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039306-f443-45b1-803c-bc5761aa5e62 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:55.725334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039306-f443-45b1-803c-bc5761aa5e62 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:55.725653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8039306-f443-45b1-803c-bc5761aa5e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:55.787273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f8039306-f443-45b1-803c-bc5761aa5e62 None None] MFA Rules not processed for user `67d682d50c1741c980b22526fd1ecdc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:55.789670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f8039306-f443-45b1-803c-bc5761aa5e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:55.905601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:55.906889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:55.907576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:55.908089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] PATH_INFO: `/v3/users/3d9845dc9ba9427dbfea5316f12e0670` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:55.911394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9845dc9ba9427dbfea5316f12e0670)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:55.918048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:55.957726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:55.969816 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1009/2028] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:56.040067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9845dc9ba9427dbfea5316f12e0670'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:56.043320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9845dc9ba9427dbfea5316f12e0670'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:56.048377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039306-f443-45b1-803c-bc5761aa5e62 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:56.053071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f8039306-f443-45b1-803c-bc5761aa5e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:56.087720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9845dc9ba9427dbfea5316f12e0670'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:56.097046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9845dc9ba9427dbfea5316f12e0670'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:56.097928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3bcdfa8c-19c8-4ee6-8e60-581b6708e78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9845dc9ba9427dbfea5316f12e0670'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:56.133305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1020/2029] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:55 2022] DELETE /identity/v3/users/3d9845dc9ba9427dbfea5316f12e0670 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:56.137652 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ad6db-41e2-438e-95fe-29f82f162a74 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:56.137948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ad6db-41e2-438e-95fe-29f82f162a74 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:56.138758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ad6db-41e2-438e-95fe-29f82f162a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:56.180903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b53ad6db-41e2-438e-95fe-29f82f162a74 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:56.182186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b53ad6db-41e2-438e-95fe-29f82f162a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:56.196219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8039306-f443-45b1-803c-bc5761aa5e62 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:56.227070 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:56.311377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1021/2030] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:04:56.318474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80c2c-b2ac-403e-b029-2622b576a2a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:56.319488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80c2c-b2ac-403e-b029-2622b576a2a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:56.319927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80c2c-b2ac-403e-b029-2622b576a2a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:56.320761 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80c2c-b2ac-403e-b029-2622b576a2a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:56.322913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ad6db-41e2-438e-95fe-29f82f162a74 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:56.323993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-05f80c2c-b2ac-403e-b029-2622b576a2a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:56.324565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b53ad6db-41e2-438e-95fe-29f82f162a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:56.410257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ad6db-41e2-438e-95fe-29f82f162a74 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:56.415235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b961b-20a8-4ca7-8342-d81b229dcc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:56.415940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b961b-20a8-4ca7-8342-d81b229dcc43 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:56.416318 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b961b-20a8-4ca7-8342-d81b229dcc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:56.416853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b961b-20a8-4ca7-8342-d81b229dcc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:56.420027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80c2c-b2ac-403e-b029-2622b576a2a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:56.422112 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80c2c-b2ac-403e-b029-2622b576a2a2 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:56.429174 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b961b-20a8-4ca7-8342-d81b229dcc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:56.431051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b961b-20a8-4ca7-8342-d81b229dcc43 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:56.437355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1010/2031] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:56.454937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1022/2032] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:04:57.355043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80c2c-b2ac-403e-b029-2622b576a2a2 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:57.363441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-05f80c2c-b2ac-403e-b029-2622b576a2a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:57.391839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80c2c-b2ac-403e-b029-2622b576a2a2 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:57.400069 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:57.400939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:57.401237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:57.401521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] PATH_INFO: `/v3/projects/da820ca19ffb4ef59a68e66a4cc063ce` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:57.402994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=da820ca19ffb4ef59a68e66a4cc063ce)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:57.405294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:57.516350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da820ca19ffb4ef59a68e66a4cc063ce', 'request_id': 'req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:57.517733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b961b-20a8-4ca7-8342-d81b229dcc43 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:57.521612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-662b961b-20a8-4ca7-8342-d81b229dcc43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:57.534235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da820ca19ffb4ef59a68e66a4cc063ce', 'request_id': 'req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:57.540157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b961b-20a8-4ca7-8342-d81b229dcc43 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:57.546768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da820ca19ffb4ef59a68e66a4cc063ce', 'request_id': 'req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:57.565512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] The token cache is being invalidate because project da820ca19ffb4ef59a68e66a4cc063ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:57.566376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:57.566768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:57.572474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1011/2033] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:57 2022] DELETE /identity/v3/projects/da820ca19ffb4ef59a68e66a4cc063ce => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:57.573647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:57.575297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:57.653033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:57.689864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6294d42-6369-409b-ba9b-0a3cd6642009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:57.691080 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6294d42-6369-409b-ba9b-0a3cd6642009 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:57.691522 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6294d42-6369-409b-ba9b-0a3cd6642009 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:57.691945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6294d42-6369-409b-ba9b-0a3cd6642009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:57.694823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f6294d42-6369-409b-ba9b-0a3cd6642009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:57.710085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:57.744541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84d623-8aa7-468b-a0cb-f28a9f0e9c1d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:57.763001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:57.764336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:57.764721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:57.765150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] PATH_INFO: `/v3/users/299bd2f7025a4006a3c59f47903c52ee` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:57.766532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299bd2f7025a4006a3c59f47903c52ee)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:57.768499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:57.852647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6294d42-6369-409b-ba9b-0a3cd6642009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:57.854871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6294d42-6369-409b-ba9b-0a3cd6642009 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:57.874403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1023/2034] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:57.876830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299bd2f7025a4006a3c59f47903c52ee'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:57.894485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299bd2f7025a4006a3c59f47903c52ee'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:57.895144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299bd2f7025a4006a3c59f47903c52ee'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:57.895820 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299bd2f7025a4006a3c59f47903c52ee'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:57.912621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c591d359-8139-4be0-8535-135b1316b067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299bd2f7025a4006a3c59f47903c52ee'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:57.949665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1012/2035] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:57 2022] DELETE /identity/v3/users/299bd2f7025a4006a3c59f47903c52ee => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:58.441231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6294d42-6369-409b-ba9b-0a3cd6642009 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:58.445056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f6294d42-6369-409b-ba9b-0a3cd6642009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:58.478841 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6294d42-6369-409b-ba9b-0a3cd6642009 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:58.749191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:58.752065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:58.752375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:58.752682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] PATH_INFO: `/v3/users/fe3e035d284a4756b4061a3250903a52` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:58.754887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3e035d284a4756b4061a3250903a52)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:58.756895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:58.884558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3e035d284a4756b4061a3250903a52'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:58.885365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3e035d284a4756b4061a3250903a52'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:58.912341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3e035d284a4756b4061a3250903a52'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:58.930962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3e035d284a4756b4061a3250903a52'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:58.932935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3e035d284a4756b4061a3250903a52'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:58.967615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1024/2036] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:04:58 2022] DELETE /identity/v3/users/fe3e035d284a4756b4061a3250903a52 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:04:58.970145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c99cc7-1a94-4c25-9ba1-98fdf4818142 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:58.972088 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c99cc7-1a94-4c25-9ba1-98fdf4818142 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:58.972740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c99cc7-1a94-4c25-9ba1-98fdf4818142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:59.012806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-73c99cc7-1a94-4c25-9ba1-98fdf4818142 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:59.014617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-73c99cc7-1a94-4c25-9ba1-98fdf4818142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:59.102977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1013/2037] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:59.109964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:59.111435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:59.132776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:59.196111 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c99cc7-1a94-4c25-9ba1-98fdf4818142 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:59.198612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-73c99cc7-1a94-4c25-9ba1-98fdf4818142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:59.220919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c99cc7-1a94-4c25-9ba1-98fdf4818142 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:59.233474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:59.234195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:59.234489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:59.234766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] PATH_INFO: `/v3/projects/0846e889cb35438a9088aaef54ade661` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:59.236031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0846e889cb35438a9088aaef54ade661)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:59.238219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:59.269343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4e49f-3fea-42cf-b945-639a92144305 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:59.274428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5032262-a264-483d-954f-8f7e3aed57ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:59.275113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032262-a264-483d-954f-8f7e3aed57ea service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:59.275806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032262-a264-483d-954f-8f7e3aed57ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:59.276090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032262-a264-483d-954f-8f7e3aed57ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:59.289159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5032262-a264-483d-954f-8f7e3aed57ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:59.290705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5032262-a264-483d-954f-8f7e3aed57ea service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:59.302923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1025/2038] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:04:59.319716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0846e889cb35438a9088aaef54ade661', 'request_id': 'req-5664d60b-c1c1-41d1-8236-90433922aae4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:59.328951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0846e889cb35438a9088aaef54ade661', 'request_id': 'req-5664d60b-c1c1-41d1-8236-90433922aae4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:59.338411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0846e889cb35438a9088aaef54ade661', 'request_id': 'req-5664d60b-c1c1-41d1-8236-90433922aae4'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:59.341970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:59.369034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] The token cache is being invalidate because project 0846e889cb35438a9088aaef54ade661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:04:59.369355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:59.370109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5664d60b-c1c1-41d1-8236-90433922aae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:59.371944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1014/2039] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:59 2022] DELETE /identity/v3/projects/0846e889cb35438a9088aaef54ade661 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:04:59.376756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123570-12dd-4596-a441-9a4f9354a0d1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:59.377040 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123570-12dd-4596-a441-9a4f9354a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:59.377323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123570-12dd-4596-a441-9a4f9354a0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:59.405464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-23123570-12dd-4596-a441-9a4f9354a0d1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:59.406721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-23123570-12dd-4596-a441-9a4f9354a0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:59.505249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1026/2040] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:59.514080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c336-1d35-47c5-a46c-697b23b0f084 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:59.515418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c336-1d35-47c5-a46c-697b23b0f084 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:59.515737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c336-1d35-47c5-a46c-697b23b0f084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:59.548389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6577c336-1d35-47c5-a46c-697b23b0f084 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:04:59.550058 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6577c336-1d35-47c5-a46c-697b23b0f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:59.561038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1015/2041] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:04:59.568403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123570-12dd-4596-a441-9a4f9354a0d1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:59.583040 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123570-12dd-4596-a441-9a4f9354a0d1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:59.589084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8c0a4-f74b-4291-aa58-00d947a24359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:59.589794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8c0a4-f74b-4291-aa58-00d947a24359 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:59.590092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8c0a4-f74b-4291-aa58-00d947a24359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:59.590398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8c0a4-f74b-4291-aa58-00d947a24359 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:59.592936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8c0a4-f74b-4291-aa58-00d947a24359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:04:59.592936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8c0a4-f74b-4291-aa58-00d947a24359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:59.593239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8c0a4-f74b-4291-aa58-00d947a24359 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:59.609521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1027/2042] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:04:59.614245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577c336-1d35-47c5-a46c-697b23b0f084 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:59.627726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577c336-1d35-47c5-a46c-697b23b0f084 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:59.636508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf389eb-a286-43e3-8c2e-8793ee39f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:59.636508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf389eb-a286-43e3-8c2e-8793ee39f539 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:59.636508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf389eb-a286-43e3-8c2e-8793ee39f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:59.636508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf389eb-a286-43e3-8c2e-8793ee39f539 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:59.637022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf389eb-a286-43e3-8c2e-8793ee39f539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:59.640085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf389eb-a286-43e3-8c2e-8793ee39f539 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:59.665116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8c0a4-f74b-4291-aa58-00d947a24359 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:59.677046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fdc8c0a4-f74b-4291-aa58-00d947a24359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:04:59.680187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1016/2043] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:04:59 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:59.681314 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf389eb-a286-43e3-8c2e-8793ee39f539 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:59.714120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8c0a4-f74b-4291-aa58-00d947a24359 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:59.787073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf389eb-a286-43e3-8c2e-8793ee39f539 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:59.796044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a7d0c-dbd2-4592-baf0-2ede01d67c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:59.797828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a7d0c-dbd2-4592-baf0-2ede01d67c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:59.798118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a7d0c-dbd2-4592-baf0-2ede01d67c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:59.799405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a7d0c-dbd2-4592-baf0-2ede01d67c4f admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:59.800240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a7d0c-dbd2-4592-baf0-2ede01d67c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:59.804144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a7d0c-dbd2-4592-baf0-2ede01d67c4f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:59.805181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:59.806626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:59.807708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:59.808074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] PATH_INFO: `/v3/projects/1fd6b244110f4c5a925d56edf07864e7` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:59.811625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd6b244110f4c5a925d56edf07864e7)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:59.817452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:59.860587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1017/2044] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:04:59 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:04:59.866813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a7d0c-dbd2-4592-baf0-2ede01d67c4f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:59.889694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a7d0c-dbd2-4592-baf0-2ede01d67c4f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:59.904087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a833e-7db0-49b2-8335-ef56933c47a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:04:59.904768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a833e-7db0-49b2-8335-ef56933c47a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:04:59.905048 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a833e-7db0-49b2-8335-ef56933c47a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:04:59.905324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a833e-7db0-49b2-8335-ef56933c47a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:04:59.906187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a833e-7db0-49b2-8335-ef56933c47a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:04:59.908000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a833e-7db0-49b2-8335-ef56933c47a4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:04:59.936022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1018/2045] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:04:59.937008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a833e-7db0-49b2-8335-ef56933c47a4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:04:59.941599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:04:59.949306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd6b244110f4c5a925d56edf07864e7', 'request_id': 'req-efef96ff-d53e-4360-8d6d-ea526b65979e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:59.971735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a833e-7db0-49b2-8335-ef56933c47a4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:04:59.980402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd6b244110f4c5a925d56edf07864e7', 'request_id': 'req-efef96ff-d53e-4360-8d6d-ea526b65979e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:04:59.993483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd6b244110f4c5a925d56edf07864e7', 'request_id': 'req-efef96ff-d53e-4360-8d6d-ea526b65979e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.025206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] The token cache is being invalidate because project 1fd6b244110f4c5a925d56edf07864e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:00.026710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.029328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.034519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1028/2046] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:04:59 2022] DELETE /identity/v3/projects/1fd6b244110f4c5a925d56edf07864e7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:00.038719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:00.041047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:00.108617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02778da4-25f9-4106-a5ab-f8b79ef244b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:00.109170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02778da4-25f9-4106-a5ab-f8b79ef244b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:00.109550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02778da4-25f9-4106-a5ab-f8b79ef244b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:00.109713 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02778da4-25f9-4106-a5ab-f8b79ef244b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:00.110398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02778da4-25f9-4106-a5ab-f8b79ef244b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:00.112670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02778da4-25f9-4106-a5ab-f8b79ef244b9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:00.136028 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1019/2047] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:00.141791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02778da4-25f9-4106-a5ab-f8b79ef244b9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:00.145241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-02778da4-25f9-4106-a5ab-f8b79ef244b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:00.171060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02778da4-25f9-4106-a5ab-f8b79ef244b9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:00.179890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc91d6-ad7b-43ec-b902-e4a44ad22315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:00.180714 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc91d6-ad7b-43ec-b902-e4a44ad22315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:00.180930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef96ff-d53e-4360-8d6d-ea526b65979e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:00.181092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc91d6-ad7b-43ec-b902-e4a44ad22315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:00.181864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc91d6-ad7b-43ec-b902-e4a44ad22315 admin admin] PATH_INFO: `/v3/projects/2b8838e9105c4476a89c5735a41dec31/users/9dccd79099644a2da0385116ea948dfe/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:00.187380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:00.188102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:00.188387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:00.188746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] PATH_INFO: `/v3/users/d6691a26c28b44b09d5efc415696b138` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:00.190240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6691a26c28b44b09d5efc415696b138)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:00.198320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:00.200811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc91d6-ad7b-43ec-b902-e4a44ad22315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8838e9105c4476a89c5735a41dec31, user_id=9dccd79099644a2da0385116ea948dfe, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:00.204009 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc91d6-ad7b-43ec-b902-e4a44ad22315 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:00.224542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1020/2048] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:00 2022] PUT /identity/v3/projects/2b8838e9105c4476a89c5735a41dec31/users/9dccd79099644a2da0385116ea948dfe/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:00.235983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3ee7b-34d3-4013-81ed-51d9dcc97198 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:00.236273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3ee7b-34d3-4013-81ed-51d9dcc97198 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:00.236773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3ee7b-34d3-4013-81ed-51d9dcc97198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:00.265048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6691a26c28b44b09d5efc415696b138'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.265973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6691a26c28b44b09d5efc415696b138'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.274242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:00.278030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-edf3ee7b-34d3-4013-81ed-51d9dcc97198 None None] MFA Rules not processed for user `9dccd79099644a2da0385116ea948dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:00.285274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-edf3ee7b-34d3-4013-81ed-51d9dcc97198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:00.298321 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6691a26c28b44b09d5efc415696b138'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.310285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6691a26c28b44b09d5efc415696b138'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.312247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6691a26c28b44b09d5efc415696b138'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.331970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1029/2049] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:00 2022] DELETE /identity/v3/users/d6691a26c28b44b09d5efc415696b138 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:00.414345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1021/2050] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:00.414630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:00.416427 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:00.492921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:00.507854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27422c5-9cdd-49af-82cd-988383d2730b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:00.514756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834282b-dfd1-4ea5-99b7-693d1e74d1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:00.515383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834282b-dfd1-4ea5-99b7-693d1e74d1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:00.515656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834282b-dfd1-4ea5-99b7-693d1e74d1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:00.515931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834282b-dfd1-4ea5-99b7-693d1e74d1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:00.516763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834282b-dfd1-4ea5-99b7-693d1e74d1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:00.521570 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834282b-dfd1-4ea5-99b7-693d1e74d1e1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:00.559284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1030/2051] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:00 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:00.560038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3ee7b-34d3-4013-81ed-51d9dcc97198 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:00.677604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3ee7b-34d3-4013-81ed-51d9dcc97198 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:00.774433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b983c6-10a5-49f9-a8a3-c4dba093f871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:00.775067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b983c6-10a5-49f9-a8a3-c4dba093f871 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:00.775418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b983c6-10a5-49f9-a8a3-c4dba093f871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:00.775761 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b983c6-10a5-49f9-a8a3-c4dba093f871 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:00.776407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b983c6-10a5-49f9-a8a3-c4dba093f871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:00.779507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b983c6-10a5-49f9-a8a3-c4dba093f871 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:00.807253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834282b-dfd1-4ea5-99b7-693d1e74d1e1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:00.814217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1022/2052] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:00 2022] POST /identity/v3/users => generated 300 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:00.815071 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d834282b-dfd1-4ea5-99b7-693d1e74d1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:00.815425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b983c6-10a5-49f9-a8a3-c4dba093f871 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:00.826910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b983c6-10a5-49f9-a8a3-c4dba093f871 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:00.827053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834282b-dfd1-4ea5-99b7-693d1e74d1e1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:00.831844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d898-050f-4dec-a35b-79f125007235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:00.832002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:00.832501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:00.832611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d898-050f-4dec-a35b-79f125007235 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:00.832793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:00.832985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d898-050f-4dec-a35b-79f125007235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:00.833139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d898-050f-4dec-a35b-79f125007235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:00.833289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] PATH_INFO: `/v3/projects/a10533340acc4ab585c0f07ed39cb860` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:00.833834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d898-050f-4dec-a35b-79f125007235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:00.834411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a10533340acc4ab585c0f07ed39cb860)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:00.835451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d898-050f-4dec-a35b-79f125007235 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:00.836484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:00.850151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1023/2053] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:05:00.851196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d898-050f-4dec-a35b-79f125007235 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:00.866126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d898-050f-4dec-a35b-79f125007235 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:00.871826 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bbf14-0811-481b-83db-a22238a52681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:00.873684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbf14-0811-481b-83db-a22238a52681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:00.873985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbf14-0811-481b-83db-a22238a52681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:00.874267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bbf14-0811-481b-83db-a22238a52681 admin admin] PATH_INFO: `/v3/projects/33446cc833864a7f82f743fee506efa8/users/635ea85bb0654e7887e5a8db4d483216/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:00.891061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bbf14-0811-481b-83db-a22238a52681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33446cc833864a7f82f743fee506efa8, user_id=635ea85bb0654e7887e5a8db4d483216, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:00.893526 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10533340acc4ab585c0f07ed39cb860', 'request_id': 'req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.893780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bbf14-0811-481b-83db-a22238a52681 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:00.903596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10533340acc4ab585c0f07ed39cb860', 'request_id': 'req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.909390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1024/2054] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:00 2022] PUT /identity/v3/projects/33446cc833864a7f82f743fee506efa8/users/635ea85bb0654e7887e5a8db4d483216/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:00.912213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10533340acc4ab585c0f07ed39cb860', 'request_id': 'req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.913442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bbf14-0811-481b-83db-a22238a52681 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:00.921363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:00.925998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] The token cache is being invalidate because project a10533340acc4ab585c0f07ed39cb860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:00.926294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.926982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:00.928886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1031/2055] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:00 2022] DELETE /identity/v3/projects/a10533340acc4ab585c0f07ed39cb860 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:00.932843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:00.934287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:00.987835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bbf14-0811-481b-83db-a22238a52681 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:00.994519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6440c-a3b3-43d8-95ce-64c7a6de830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:00.995501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6440c-a3b3-43d8-95ce-64c7a6de830c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:00.995671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6440c-a3b3-43d8-95ce-64c7a6de830c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:00.995822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6440c-a3b3-43d8-95ce-64c7a6de830c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:00.996676 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6440c-a3b3-43d8-95ce-64c7a6de830c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:00.998551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6440c-a3b3-43d8-95ce-64c7a6de830c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:01.014153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f54b4c-c50b-45e9-86c3-0c7955a6f5d2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:01.019926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1025/2056] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:01.021013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6440c-a3b3-43d8-95ce-64c7a6de830c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:01.023104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-46f6440c-a3b3-43d8-95ce-64c7a6de830c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:01.025465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:01.026151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:01.026537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:01.026820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] PATH_INFO: `/v3/users/e1faddff30944d368d3df96c93803be7` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:01.027978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1faddff30944d368d3df96c93803be7)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:01.030555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:01.036878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6440c-a3b3-43d8-95ce-64c7a6de830c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:01.042008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c072-7c86-4efe-8042-246b9bb23c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:01.042685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c072-7c86-4efe-8042-246b9bb23c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:01.042976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c072-7c86-4efe-8042-246b9bb23c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:01.043255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c072-7c86-4efe-8042-246b9bb23c6a admin admin] PATH_INFO: `/v3/projects/33446cc833864a7f82f743fee506efa8/users/635ea85bb0654e7887e5a8db4d483216/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:01.045874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c072-7c86-4efe-8042-246b9bb23c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33446cc833864a7f82f743fee506efa8, user_id=635ea85bb0654e7887e5a8db4d483216, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:01.048562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c072-7c86-4efe-8042-246b9bb23c6a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:01.059215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1026/2057] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:01 2022] PUT /identity/v3/projects/33446cc833864a7f82f743fee506efa8/users/635ea85bb0654e7887e5a8db4d483216/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:01.069997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d30b8-fb0b-4d71-ada5-0c6b53846dc5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:01.070303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d30b8-fb0b-4d71-ada5-0c6b53846dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:01.070786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d30b8-fb0b-4d71-ada5-0c6b53846dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:01.087590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1faddff30944d368d3df96c93803be7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.088261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1faddff30944d368d3df96c93803be7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.099418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:01.101656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1faddff30944d368d3df96c93803be7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.102675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-390d30b8-fb0b-4d71-ada5-0c6b53846dc5 None None] MFA Rules not processed for user `635ea85bb0654e7887e5a8db4d483216`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:01.103944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-390d30b8-fb0b-4d71-ada5-0c6b53846dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:01.113765 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1faddff30944d368d3df96c93803be7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.114822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1faddff30944d368d3df96c93803be7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.131469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1032/2058] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:00 2022] DELETE /identity/v3/users/e1faddff30944d368d3df96c93803be7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:01.201573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1027/2059] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:01.219663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:01.221183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:01.315070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330de75-d8f4-4e67-b8eb-fb5c2f6ca570 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:01.319312 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d454b2-1457-4dd1-a780-42e6075dadb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:01.319934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d454b2-1457-4dd1-a780-42e6075dadb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:01.320218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d454b2-1457-4dd1-a780-42e6075dadb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:01.320513 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d454b2-1457-4dd1-a780-42e6075dadb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:01.402014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d454b2-1457-4dd1-a780-42e6075dadb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:01.403749 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d454b2-1457-4dd1-a780-42e6075dadb2 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:01.415862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1033/2060] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:01.516223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d30b8-fb0b-4d71-ada5-0c6b53846dc5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:01.516343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-390d30b8-fb0b-4d71-ada5-0c6b53846dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:01.530189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d454b2-1457-4dd1-a780-42e6075dadb2 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:01.533423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f5d454b2-1457-4dd1-a780-42e6075dadb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:01.660045 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d30b8-fb0b-4d71-ada5-0c6b53846dc5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:01.665857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d454b2-1457-4dd1-a780-42e6075dadb2 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:01.669660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:01.670842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:01.671282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:01.671710 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] PATH_INFO: `/v3/projects/92aacfa023514957859ccd72f36e3ff9` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:01.673122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92aacfa023514957859ccd72f36e3ff9)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:01.675202 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:01.692761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:01.693593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:01.693974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:01.694472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] PATH_INFO: `/v3/users/9dccd79099644a2da0385116ea948dfe` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:01.697875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dccd79099644a2da0385116ea948dfe)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:01.700201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:01.708245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:01.783084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:01.803002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92aacfa023514957859ccd72f36e3ff9', 'request_id': 'req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.811279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92aacfa023514957859ccd72f36e3ff9', 'request_id': 'req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.818746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dccd79099644a2da0385116ea948dfe'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.819930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dccd79099644a2da0385116ea948dfe'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.822156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92aacfa023514957859ccd72f36e3ff9', 'request_id': 'req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.845917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] The token cache is being invalidate because project 92aacfa023514957859ccd72f36e3ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:01.846949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.847866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c5b1e2f8-fb85-4cb2-b70d-f39ce2b78569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.860908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1028/2061] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:01 2022] DELETE /identity/v3/projects/92aacfa023514957859ccd72f36e3ff9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:01.861160 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dccd79099644a2da0385116ea948dfe'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.861263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0dd53-1902-4e78-b0ac-f0c1b3241cac None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:01.861263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0dd53-1902-4e78-b0ac-f0c1b3241cac None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:01.861263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0dd53-1902-4e78-b0ac-f0c1b3241cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:01.871456 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dccd79099644a2da0385116ea948dfe'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.873850 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-12a4a786-3105-4465-bfb9-ee3caa3fa5cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dccd79099644a2da0385116ea948dfe'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:01.883450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0ef0dd53-1902-4e78-b0ac-f0c1b3241cac None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:01.885030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0ef0dd53-1902-4e78-b0ac-f0c1b3241cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:01.890585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1034/2062] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:01 2022] DELETE /identity/v3/users/9dccd79099644a2da0385116ea948dfe => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:01.895204 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700c421-602f-4078-bf1b-4dddbdd4221c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:01.895498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700c421-602f-4078-bf1b-4dddbdd4221c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:01.895778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700c421-602f-4078-bf1b-4dddbdd4221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:01.917895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1700c421-602f-4078-bf1b-4dddbdd4221c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:01.919125 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1700c421-602f-4078-bf1b-4dddbdd4221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:01.962195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1029/2063] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:01.970878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655cdfd-a2c0-40bb-84a3-c77355709bf2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:01.971170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655cdfd-a2c0-40bb-84a3-c77355709bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:01.971775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655cdfd-a2c0-40bb-84a3-c77355709bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:01.993652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5655cdfd-a2c0-40bb-84a3-c77355709bf2 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:01.994839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5655cdfd-a2c0-40bb-84a3-c77355709bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:01.996203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1035/2064] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:02.008094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1030/2065] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:02.009225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700c421-602f-4078-bf1b-4dddbdd4221c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.010739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1700c421-602f-4078-bf1b-4dddbdd4221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:02.012147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655cdfd-a2c0-40bb-84a3-c77355709bf2 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.021646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655cdfd-a2c0-40bb-84a3-c77355709bf2 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:02.028209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba216ad-b88f-4b76-a345-1fc0b9e213ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:02.028884 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba216ad-b88f-4b76-a345-1fc0b9e213ab admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.029383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba216ad-b88f-4b76-a345-1fc0b9e213ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.029662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba216ad-b88f-4b76-a345-1fc0b9e213ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.030599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba216ad-b88f-4b76-a345-1fc0b9e213ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:02.030599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba216ad-b88f-4b76-a345-1fc0b9e213ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:02.032201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba216ad-b88f-4b76-a345-1fc0b9e213ab admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:02.046961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1031/2066] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 17:05:02.052622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba216ad-b88f-4b76-a345-1fc0b9e213ab admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.067765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba216ad-b88f-4b76-a345-1fc0b9e213ab admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:02.077057 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76305b6a-3b19-4a12-80ec-62a45105f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:02.077793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76305b6a-3b19-4a12-80ec-62a45105f035 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.078085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76305b6a-3b19-4a12-80ec-62a45105f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.078458 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76305b6a-3b19-4a12-80ec-62a45105f035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.079524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76305b6a-3b19-4a12-80ec-62a45105f035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:02.081722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76305b6a-3b19-4a12-80ec-62a45105f035 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:02.122315 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700c421-602f-4078-bf1b-4dddbdd4221c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:02.130726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5456a6e-1b9d-4d79-885d-f767048ffa55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:02.131365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5456a6e-1b9d-4d79-885d-f767048ffa55 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.131649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5456a6e-1b9d-4d79-885d-f767048ffa55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.131927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5456a6e-1b9d-4d79-885d-f767048ffa55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.136124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1032/2067] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:02 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:02.137859 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76305b6a-3b19-4a12-80ec-62a45105f035 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.154397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5456a6e-1b9d-4d79-885d-f767048ffa55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:02.155859 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5456a6e-1b9d-4d79-885d-f767048ffa55 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:02.185749 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1036/2068] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:02.312332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76305b6a-3b19-4a12-80ec-62a45105f035 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:02.324149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214bd7e-85a5-4a58-af3e-facd6c7a4b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:02.325001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214bd7e-85a5-4a58-af3e-facd6c7a4b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.325344 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214bd7e-85a5-4a58-af3e-facd6c7a4b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.325748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214bd7e-85a5-4a58-af3e-facd6c7a4b78 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.326453 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214bd7e-85a5-4a58-af3e-facd6c7a4b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:02.329928 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8214bd7e-85a5-4a58-af3e-facd6c7a4b78 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:02.341808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:02.361721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1033/2069] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:02 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:02.362974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5456a6e-1b9d-4d79-885d-f767048ffa55 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.377150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5456a6e-1b9d-4d79-885d-f767048ffa55 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:02.393259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d726a-d57c-49b9-ab86-4b78f74776cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:02.394239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d726a-d57c-49b9-ab86-4b78f74776cf admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.394517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d726a-d57c-49b9-ab86-4b78f74776cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.394792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d726a-d57c-49b9-ab86-4b78f74776cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.395452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d726a-d57c-49b9-ab86-4b78f74776cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:02.397138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d726a-d57c-49b9-ab86-4b78f74776cf admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:02.413474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1037/2070] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:02.421839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214bd7e-85a5-4a58-af3e-facd6c7a4b78 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.439913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214bd7e-85a5-4a58-af3e-facd6c7a4b78 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:02.444919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35bea5-1699-471c-887e-72dbd5a5f718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:02.445498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35bea5-1699-471c-887e-72dbd5a5f718 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.445776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35bea5-1699-471c-887e-72dbd5a5f718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.446047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35bea5-1699-471c-887e-72dbd5a5f718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.446692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35bea5-1699-471c-887e-72dbd5a5f718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:02.448498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35bea5-1699-471c-887e-72dbd5a5f718 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:02.459555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1034/2071] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:02.465576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d726a-d57c-49b9-ab86-4b78f74776cf admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.476247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d726a-d57c-49b9-ab86-4b78f74776cf admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:02.486185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c65f1-3cae-4051-9dd9-fb4ffb9bf1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:02.486408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c65f1-3cae-4051-9dd9-fb4ffb9bf1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.488400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c65f1-3cae-4051-9dd9-fb4ffb9bf1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.488400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c65f1-3cae-4051-9dd9-fb4ffb9bf1b1 admin admin] PATH_INFO: `/v3/projects/4459a3645a2b466384d2bd850ef2a8f4/users/48fe68c720314bcd9f69b2b0bd4c4688/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.504977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c65f1-3cae-4051-9dd9-fb4ffb9bf1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4459a3645a2b466384d2bd850ef2a8f4, user_id=48fe68c720314bcd9f69b2b0bd4c4688, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:02.508062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c65f1-3cae-4051-9dd9-fb4ffb9bf1b1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:02.524842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1038/2072] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:02 2022] PUT /identity/v3/projects/4459a3645a2b466384d2bd850ef2a8f4/users/48fe68c720314bcd9f69b2b0bd4c4688/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:02.540031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877802b-7b35-4b19-96ab-48333605f399 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.540228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877802b-7b35-4b19-96ab-48333605f399 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.540544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877802b-7b35-4b19-96ab-48333605f399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.546004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c65f1-3cae-4051-9dd9-fb4ffb9bf1b1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.548480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f85c65f1-3cae-4051-9dd9-fb4ffb9bf1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:02.578640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:02.605829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7877802b-7b35-4b19-96ab-48333605f399 None None] MFA Rules not processed for user `48fe68c720314bcd9f69b2b0bd4c4688`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:02.610609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7877802b-7b35-4b19-96ab-48333605f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:02.647353 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c65f1-3cae-4051-9dd9-fb4ffb9bf1b1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:02.654558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:02.655899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.656444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.656822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] PATH_INFO: `/v3/projects/2b8838e9105c4476a89c5735a41dec31` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.658407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8838e9105c4476a89c5735a41dec31)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:02.661930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:02.693146 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1035/2073] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:02.722345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877802b-7b35-4b19-96ab-48333605f399 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.724427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7877802b-7b35-4b19-96ab-48333605f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:02.729834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8838e9105c4476a89c5735a41dec31', 'request_id': 'req-ce51e859-4369-4a85-b474-c71ef60397d9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:02.747220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8838e9105c4476a89c5735a41dec31', 'request_id': 'req-ce51e859-4369-4a85-b474-c71ef60397d9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:02.754745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8838e9105c4476a89c5735a41dec31', 'request_id': 'req-ce51e859-4369-4a85-b474-c71ef60397d9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:02.768426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] The token cache is being invalidate because project 2b8838e9105c4476a89c5735a41dec31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:02.768843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:02.769563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:02.771109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1039/2074] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:02 2022] DELETE /identity/v3/projects/2b8838e9105c4476a89c5735a41dec31 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:02.775091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.776422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:02.809996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877802b-7b35-4b19-96ab-48333605f399 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:02.856035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51e859-4369-4a85-b474-c71ef60397d9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:02.861046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:02.861829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.862115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.862413 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] PATH_INFO: `/v3/users/635ea85bb0654e7887e5a8db4d483216` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.863666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=635ea85bb0654e7887e5a8db4d483216)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:02.865806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:02.879350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27298ea8-9e2a-4a6e-87dd-6aa38f6c6570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:02.880073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27298ea8-9e2a-4a6e-87dd-6aa38f6c6570 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:02.880432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27298ea8-9e2a-4a6e-87dd-6aa38f6c6570 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:02.880840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27298ea8-9e2a-4a6e-87dd-6aa38f6c6570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:02.883444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-27298ea8-9e2a-4a6e-87dd-6aa38f6c6570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:02.938007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '635ea85bb0654e7887e5a8db4d483216'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:02.938718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '635ea85bb0654e7887e5a8db4d483216'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:02.939926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:02.948177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:02.959416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '635ea85bb0654e7887e5a8db4d483216'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:02.967187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '635ea85bb0654e7887e5a8db4d483216'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:02.967898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '635ea85bb0654e7887e5a8db4d483216'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:02.973359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27298ea8-9e2a-4a6e-87dd-6aa38f6c6570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:02.975479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27298ea8-9e2a-4a6e-87dd-6aa38f6c6570 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:02.986284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1040/2075] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:02 2022] DELETE /identity/v3/users/635ea85bb0654e7887e5a8db4d483216 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:02.988623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:02.989604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1036/2076] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:05:02.990733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.012759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27298ea8-9e2a-4a6e-87dd-6aa38f6c6570 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:03.015678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-27298ea8-9e2a-4a6e-87dd-6aa38f6c6570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.034563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27298ea8-9e2a-4a6e-87dd-6aa38f6c6570 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:03.112640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59074c86-1b24-4c6b-9a24-f1b28c99cd79 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:03.119387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9d64-1389-42aa-8d7e-c57034e667ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:03.120214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9d64-1389-42aa-8d7e-c57034e667ac service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:03.121057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9d64-1389-42aa-8d7e-c57034e667ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:03.121498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9d64-1389-42aa-8d7e-c57034e667ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:03.124488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a48d9d64-1389-42aa-8d7e-c57034e667ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.131052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:03.132894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:03.134947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:03.136179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] PATH_INFO: `/v3/users/48fe68c720314bcd9f69b2b0bd4c4688` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:03.142841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fe68c720314bcd9f69b2b0bd4c4688)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:03.148535 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:03.218954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9d64-1389-42aa-8d7e-c57034e667ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:03.220424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9d64-1389-42aa-8d7e-c57034e667ac service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:03.242809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1041/2077] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:03.243716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9d64-1389-42aa-8d7e-c57034e667ac service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:03.245257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a48d9d64-1389-42aa-8d7e-c57034e667ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.250018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fe68c720314bcd9f69b2b0bd4c4688'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.261969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9d64-1389-42aa-8d7e-c57034e667ac service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:03.265462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fe68c720314bcd9f69b2b0bd4c4688'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.266929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fe68c720314bcd9f69b2b0bd4c4688'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.268674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fe68c720314bcd9f69b2b0bd4c4688'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.269089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:03.269837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:03.270214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:03.270609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] PATH_INFO: `/v3/users/d60d90927dfd47e588618706c394c23a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:03.272251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60d90927dfd47e588618706c394c23a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:03.276134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:03.283763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0a02bac1-1962-4280-8542-93194ce9bab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fe68c720314bcd9f69b2b0bd4c4688'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.319097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1037/2078] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:03 2022] DELETE /identity/v3/users/48fe68c720314bcd9f69b2b0bd4c4688 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:03.326767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7a43c-d4e8-4037-b5c2-a71433cf1b18 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:03.327562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7a43c-d4e8-4037-b5c2-a71433cf1b18 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:03.328171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7a43c-d4e8-4037-b5c2-a71433cf1b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:03.341978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60d90927dfd47e588618706c394c23a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.342081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60d90927dfd47e588618706c394c23a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.360490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60d90927dfd47e588618706c394c23a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.370593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60d90927dfd47e588618706c394c23a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.371197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9bf7a43c-d4e8-4037-b5c2-a71433cf1b18 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:03.371325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e96ad7f2-e38a-47a8-879f-33dc5f12122f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60d90927dfd47e588618706c394c23a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.374402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:03.374861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9bf7a43c-d4e8-4037-b5c2-a71433cf1b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.393509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1042/2079] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:03 2022] DELETE /identity/v3/users/d60d90927dfd47e588618706c394c23a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:03.399154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f050b-1dda-41c0-9f36-1da52a7edcdb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:03.399435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f050b-1dda-41c0-9f36-1da52a7edcdb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:03.399716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f050b-1dda-41c0-9f36-1da52a7edcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:03.442433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3e6f050b-1dda-41c0-9f36-1da52a7edcdb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:03.444696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3e6f050b-1dda-41c0-9f36-1da52a7edcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.469227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:03.491426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1038/2080] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:03.493445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7a43c-d4e8-4037-b5c2-a71433cf1b18 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:03.495855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9bf7a43c-d4e8-4037-b5c2-a71433cf1b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.518147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7a43c-d4e8-4037-b5c2-a71433cf1b18 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:03.561219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1043/2081] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:03.561219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f050b-1dda-41c0-9f36-1da52a7edcdb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:03.561219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3e6f050b-1dda-41c0-9f36-1da52a7edcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.611170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:03.612272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:03.612849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:03.613305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] PATH_INFO: `/v3/projects/33446cc833864a7f82f743fee506efa8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:03.614634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33446cc833864a7f82f743fee506efa8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:03.616597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:03.665318 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f050b-1dda-41c0-9f36-1da52a7edcdb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:03.673786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0936ab-eb6d-4912-8cb2-9654e01f9450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:03.675205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0936ab-eb6d-4912-8cb2-9654e01f9450 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:03.675367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0936ab-eb6d-4912-8cb2-9654e01f9450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:03.675893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0936ab-eb6d-4912-8cb2-9654e01f9450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:03.695063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0936ab-eb6d-4912-8cb2-9654e01f9450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:03.696623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33446cc833864a7f82f743fee506efa8', 'request_id': 'req-19b12667-1c8c-4d69-ad76-79ef42b494d7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.696774 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0936ab-eb6d-4912-8cb2-9654e01f9450 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:03.704000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33446cc833864a7f82f743fee506efa8', 'request_id': 'req-19b12667-1c8c-4d69-ad76-79ef42b494d7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.710043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1044/2082] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:03.711529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0936ab-eb6d-4912-8cb2-9654e01f9450 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:03.714518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33446cc833864a7f82f743fee506efa8', 'request_id': 'req-19b12667-1c8c-4d69-ad76-79ef42b494d7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.726581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0936ab-eb6d-4912-8cb2-9654e01f9450 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:03.738440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] The token cache is being invalidate because project 33446cc833864a7f82f743fee506efa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:03.739083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.740315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19b12667-1c8c-4d69-ad76-79ef42b494d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:03.744361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1039/2083] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:03 2022] DELETE /identity/v3/projects/33446cc833864a7f82f743fee506efa8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:03.751456 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222759c-942f-428c-b83a-54e0d5689b04 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:03.751918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222759c-942f-428c-b83a-54e0d5689b04 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:03.752378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222759c-942f-428c-b83a-54e0d5689b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:03.791483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7222759c-942f-428c-b83a-54e0d5689b04 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:03.793976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7222759c-942f-428c-b83a-54e0d5689b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.808921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad6bdd-0467-4dc1-9ac9-6ff7f4dfe9c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:03.810426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad6bdd-0467-4dc1-9ac9-6ff7f4dfe9c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:03.811070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad6bdd-0467-4dc1-9ac9-6ff7f4dfe9c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:03.811497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad6bdd-0467-4dc1-9ac9-6ff7f4dfe9c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:03.813938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e6ad6bdd-0467-4dc1-9ac9-6ff7f4dfe9c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.882849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:03.909253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad6bdd-0467-4dc1-9ac9-6ff7f4dfe9c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:03.911154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad6bdd-0467-4dc1-9ac9-6ff7f4dfe9c7 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:03.917449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1040/2084] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:03.924830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161a4ad-7147-43e6-8265-766afe168e43 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:03.925333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161a4ad-7147-43e6-8265-766afe168e43 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:03.925980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161a4ad-7147-43e6-8265-766afe168e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:03.928492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1045/2085] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:03.964666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8161a4ad-7147-43e6-8265-766afe168e43 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:03.967295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8161a4ad-7147-43e6-8265-766afe168e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:03.988079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1041/2086] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:03.989471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad6bdd-0467-4dc1-9ac9-6ff7f4dfe9c7 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:04.002187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad6bdd-0467-4dc1-9ac9-6ff7f4dfe9c7 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:04.007187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b50f-255a-42dc-972e-ee19792fc92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:04.007812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b50f-255a-42dc-972e-ee19792fc92b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.008100 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b50f-255a-42dc-972e-ee19792fc92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.008429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b50f-255a-42dc-972e-ee19792fc92b admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.009131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5b50f-255a-42dc-972e-ee19792fc92b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:04.009433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5b50f-255a-42dc-972e-ee19792fc92b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:04.011448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5b50f-255a-42dc-972e-ee19792fc92b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:04.029071 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1046/2087] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:04.034171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161a4ad-7147-43e6-8265-766afe168e43 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:04.052532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161a4ad-7147-43e6-8265-766afe168e43 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:04.055784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1d1a7-99f1-4cd1-8620-63f151898352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:04.056598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1d1a7-99f1-4cd1-8620-63f151898352 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.057495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1d1a7-99f1-4cd1-8620-63f151898352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.058010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1d1a7-99f1-4cd1-8620-63f151898352 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.058966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1d1a7-99f1-4cd1-8620-63f151898352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:04.061740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1d1a7-99f1-4cd1-8620-63f151898352 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:04.110092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1042/2088] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:04 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:04.111298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b50f-255a-42dc-972e-ee19792fc92b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:04.133864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b50f-255a-42dc-972e-ee19792fc92b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:04.284263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1d1a7-99f1-4cd1-8620-63f151898352 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:04.287489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5ac1d1a7-99f1-4cd1-8620-63f151898352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:04.294316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:04.360898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383481b-fb6a-4d07-9cb5-7f138973c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:04.361638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383481b-fb6a-4d07-9cb5-7f138973c34f admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.363749 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383481b-fb6a-4d07-9cb5-7f138973c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.363872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383481b-fb6a-4d07-9cb5-7f138973c34f admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.366472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383481b-fb6a-4d07-9cb5-7f138973c34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:04.369791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383481b-fb6a-4d07-9cb5-7f138973c34f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:04.424262 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1d1a7-99f1-4cd1-8620-63f151898352 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:04.429328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1047/2089] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:04 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:04.433813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383481b-fb6a-4d07-9cb5-7f138973c34f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:04.434895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:04.435796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.436075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.436355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] PATH_INFO: `/v3/projects/4459a3645a2b466384d2bd850ef2a8f4` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.438146 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4459a3645a2b466384d2bd850ef2a8f4)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:04.440300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:04.464600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383481b-fb6a-4d07-9cb5-7f138973c34f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:04.486126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c80f8-690f-4afa-bf62-2ea1be8269e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:04.486950 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c80f8-690f-4afa-bf62-2ea1be8269e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.487556 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c80f8-690f-4afa-bf62-2ea1be8269e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.487556 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c80f8-690f-4afa-bf62-2ea1be8269e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.491491 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c80f8-690f-4afa-bf62-2ea1be8269e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:04.494969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c80f8-690f-4afa-bf62-2ea1be8269e2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:04.525705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1048/2090] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:05:04.540714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c80f8-690f-4afa-bf62-2ea1be8269e2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:04.541090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4459a3645a2b466384d2bd850ef2a8f4', 'request_id': 'req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:04.547545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4459a3645a2b466384d2bd850ef2a8f4', 'request_id': 'req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:04.555419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c80f8-690f-4afa-bf62-2ea1be8269e2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:04.557525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4459a3645a2b466384d2bd850ef2a8f4', 'request_id': 'req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:04.573264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] The token cache is being invalidate because project 4459a3645a2b466384d2bd850ef2a8f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:04.573552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:04.574244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ba8ddc93-93b0-4f8a-82cc-27dfffe2c985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:04.576300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1043/2091] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:04 2022] DELETE /identity/v3/projects/4459a3645a2b466384d2bd850ef2a8f4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:04.583522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6696-3ecf-4eda-bd96-6ec9758563d4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.585065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6696-3ecf-4eda-bd96-6ec9758563d4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.586951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6696-3ecf-4eda-bd96-6ec9758563d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.623739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7e1e6696-3ecf-4eda-bd96-6ec9758563d4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:04.625408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7e1e6696-3ecf-4eda-bd96-6ec9758563d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:04.650277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774569e6-21af-4a54-8377-7b75f236ba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:04.651551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774569e6-21af-4a54-8377-7b75f236ba4d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.652089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774569e6-21af-4a54-8377-7b75f236ba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.652386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774569e6-21af-4a54-8377-7b75f236ba4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.653239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774569e6-21af-4a54-8377-7b75f236ba4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:04.655072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774569e6-21af-4a54-8377-7b75f236ba4d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:04.680109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1049/2092] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:04.680109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774569e6-21af-4a54-8377-7b75f236ba4d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:04.682128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-774569e6-21af-4a54-8377-7b75f236ba4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:04.697838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774569e6-21af-4a54-8377-7b75f236ba4d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:04.703610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dbd87-ceca-4853-a84c-a0864913f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:04.704502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dbd87-ceca-4853-a84c-a0864913f354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.704798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dbd87-ceca-4853-a84c-a0864913f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.705079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dbd87-ceca-4853-a84c-a0864913f354 admin admin] PATH_INFO: `/v3/projects/4bfa495caf7e405d811e89de1d06f9be/users/80b5dab01f7444f493495977db7a57c3/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.733978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1044/2093] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:04.738721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6696-3ecf-4eda-bd96-6ec9758563d4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:04.741116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7e1e6696-3ecf-4eda-bd96-6ec9758563d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:04.745294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dbd87-ceca-4853-a84c-a0864913f354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfa495caf7e405d811e89de1d06f9be, user_id=80b5dab01f7444f493495977db7a57c3, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:04.750019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dbd87-ceca-4853-a84c-a0864913f354 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:04.761736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6696-3ecf-4eda-bd96-6ec9758563d4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:04.769287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1050/2094] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:04 2022] PUT /identity/v3/projects/4bfa495caf7e405d811e89de1d06f9be/users/80b5dab01f7444f493495977db7a57c3/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:04.770383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065cc92-2a42-4a13-bd62-713d97281968 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.770747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065cc92-2a42-4a13-bd62-713d97281968 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.771094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065cc92-2a42-4a13-bd62-713d97281968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.797022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e065cc92-2a42-4a13-bd62-713d97281968 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:04.798825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e065cc92-2a42-4a13-bd62-713d97281968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:04.816798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:04.824475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:04.854277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:04.854920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.855200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.855477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] PATH_INFO: `/v3/projects/95aa7b7ac35d46148cbc0df83b24160e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.857209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95aa7b7ac35d46148cbc0df83b24160e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:04.859959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:04.884629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1051/2095] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:04.891676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c565af5-25f6-47b2-9187-59863a2a2d00 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:04.892017 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c565af5-25f6-47b2-9187-59863a2a2d00 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:04.892886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c565af5-25f6-47b2-9187-59863a2a2d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:04.918191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95aa7b7ac35d46148cbc0df83b24160e', 'request_id': 'req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:04.926175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95aa7b7ac35d46148cbc0df83b24160e', 'request_id': 'req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:04.926898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8c565af5-25f6-47b2-9187-59863a2a2d00 None None] MFA Rules not processed for user `80b5dab01f7444f493495977db7a57c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:04.928203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8c565af5-25f6-47b2-9187-59863a2a2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:04.935427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95aa7b7ac35d46148cbc0df83b24160e', 'request_id': 'req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:04.947402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] The token cache is being invalidate because project 95aa7b7ac35d46148cbc0df83b24160e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:04.948685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:04.949531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:04.951397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1045/2096] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:04 2022] DELETE /identity/v3/projects/95aa7b7ac35d46148cbc0df83b24160e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:04.952576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:04.954172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:05.008940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1052/2097] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:05.009839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c565af5-25f6-47b2-9187-59863a2a2d00 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:05.011506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8c565af5-25f6-47b2-9187-59863a2a2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:05.030768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821d5c9-be1e-4e16-9fc9-194ae0804aa2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:05.035909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce1410-1a91-4274-94b4-74c0547b6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:05.036996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce1410-1a91-4274-94b4-74c0547b6bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.037366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce1410-1a91-4274-94b4-74c0547b6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.037669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce1410-1a91-4274-94b4-74c0547b6bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.038652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce1410-1a91-4274-94b4-74c0547b6bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:05.038794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce1410-1a91-4274-94b4-74c0547b6bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:05.040628 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce1410-1a91-4274-94b4-74c0547b6bb4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:05.055163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1046/2098] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:05.056361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce1410-1a91-4274-94b4-74c0547b6bb4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:05.058165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4cce1410-1a91-4274-94b4-74c0547b6bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:05.086292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c565af5-25f6-47b2-9187-59863a2a2d00 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:05.090983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:05.091783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.092065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.092335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] PATH_INFO: `/v3/users/343335007828434cb1f5c88709d17589` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.093551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343335007828434cb1f5c88709d17589)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:05.095483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:05.117069 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce1410-1a91-4274-94b4-74c0547b6bb4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:05.121278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75491d-8117-4c83-bdbe-c198d3cc65b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:05.122135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75491d-8117-4c83-bdbe-c198d3cc65b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.122982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75491d-8117-4c83-bdbe-c198d3cc65b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.123316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75491d-8117-4c83-bdbe-c198d3cc65b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.133095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75491d-8117-4c83-bdbe-c198d3cc65b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:05.134852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75491d-8117-4c83-bdbe-c198d3cc65b9 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:05.140586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:05.143776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343335007828434cb1f5c88709d17589'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:05.144440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343335007828434cb1f5c88709d17589'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:05.147186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1047/2099] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:05.148154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75491d-8117-4c83-bdbe-c198d3cc65b9 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:05.153320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:05.159970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75491d-8117-4c83-bdbe-c198d3cc65b9 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:05.162985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343335007828434cb1f5c88709d17589'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:05.165345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b90073-5816-4878-be27-73ea319e4a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:05.166273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b90073-5816-4878-be27-73ea319e4a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.166273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b90073-5816-4878-be27-73ea319e4a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.166505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b90073-5816-4878-be27-73ea319e4a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.167134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b90073-5816-4878-be27-73ea319e4a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:05.169173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b90073-5816-4878-be27-73ea319e4a7c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:05.172333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343335007828434cb1f5c88709d17589'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:05.173148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343335007828434cb1f5c88709d17589'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:05.187453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1053/2100] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:05 2022] DELETE /identity/v3/users/343335007828434cb1f5c88709d17589 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:05.208545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1048/2101] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:05 2022] POST /identity/v3/projects => generated 361 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:05.212588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:05.214125 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:05.298636 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0ed65-b760-4ee4-b1f6-36a440a9dc74 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:05.384473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd74df-ad32-492b-bb5d-d05b36a41dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:05.385279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd74df-ad32-492b-bb5d-d05b36a41dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.385631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd74df-ad32-492b-bb5d-d05b36a41dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.386011 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd74df-ad32-492b-bb5d-d05b36a41dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.386721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd74df-ad32-492b-bb5d-d05b36a41dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:05.389459 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd74df-ad32-492b-bb5d-d05b36a41dc3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:05.420117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1054/2102] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:05 2022] POST /identity/v3/users => generated 281 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:05.421182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b90073-5816-4878-be27-73ea319e4a7c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:05.436736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b90073-5816-4878-be27-73ea319e4a7c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:05.442434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8871f-27af-41c7-b004-381f78cee89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:05.443276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8871f-27af-41c7-b004-381f78cee89d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.443630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8871f-27af-41c7-b004-381f78cee89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.443977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8871f-27af-41c7-b004-381f78cee89d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.444788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8871f-27af-41c7-b004-381f78cee89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:05.447151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8871f-27af-41c7-b004-381f78cee89d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:05.464188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1049/2103] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:05:05.467941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd74df-ad32-492b-bb5d-d05b36a41dc3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:05.481685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd74df-ad32-492b-bb5d-d05b36a41dc3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:05.487013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7c7a0-14ea-42a8-a172-d06310c6dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:05.487771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7c7a0-14ea-42a8-a172-d06310c6dfdc admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.488165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7c7a0-14ea-42a8-a172-d06310c6dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.488582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7c7a0-14ea-42a8-a172-d06310c6dfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.490199 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7c7a0-14ea-42a8-a172-d06310c6dfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:05.492606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7c7a0-14ea-42a8-a172-d06310c6dfdc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:05.507814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1055/2104] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:05.510294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8871f-27af-41c7-b004-381f78cee89d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:05.524705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8871f-27af-41c7-b004-381f78cee89d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:05.532854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbe609-7e2a-4c6b-9135-f5c0a4bfaec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:05.533746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbe609-7e2a-4c6b-9135-f5c0a4bfaec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.534183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbe609-7e2a-4c6b-9135-f5c0a4bfaec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.534830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbe609-7e2a-4c6b-9135-f5c0a4bfaec2 admin admin] PATH_INFO: `/v3/projects/67d63120429e44e1a5703ac078d07733/users/1860d0d5f91a435498745c3fcb54c7e8/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.548505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7c7a0-14ea-42a8-a172-d06310c6dfdc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:05.550366 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-abb7c7a0-14ea-42a8-a172-d06310c6dfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:05.567565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbe609-7e2a-4c6b-9135-f5c0a4bfaec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d63120429e44e1a5703ac078d07733, user_id=1860d0d5f91a435498745c3fcb54c7e8, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:05.570267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbe609-7e2a-4c6b-9135-f5c0a4bfaec2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:05.580707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7c7a0-14ea-42a8-a172-d06310c6dfdc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:05.594369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1050/2105] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:05 2022] PUT /identity/v3/projects/67d63120429e44e1a5703ac078d07733/users/1860d0d5f91a435498745c3fcb54c7e8/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:05.606207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f58b4-2ff3-42f7-a25a-acc4c8691b5d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.606495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f58b4-2ff3-42f7-a25a-acc4c8691b5d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.606813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f58b4-2ff3-42f7-a25a-acc4c8691b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.645503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1c6f58b4-2ff3-42f7-a25a-acc4c8691b5d None None] MFA Rules not processed for user `1860d0d5f91a435498745c3fcb54c7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:05.646908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1c6f58b4-2ff3-42f7-a25a-acc4c8691b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:05.682233 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:05.718419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:05.719132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.719502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.720052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] PATH_INFO: `/v3/projects/118c039f5cee424690dc05978e25dfd6` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.721534 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118c039f5cee424690dc05978e25dfd6)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:05.725084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:05.788844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1051/2106] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:05.816866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118c039f5cee424690dc05978e25dfd6', 'request_id': 'req-171e5d1f-d048-47e3-9639-e2eadce59620'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:05.826172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118c039f5cee424690dc05978e25dfd6', 'request_id': 'req-171e5d1f-d048-47e3-9639-e2eadce59620'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:05.829395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f58b4-2ff3-42f7-a25a-acc4c8691b5d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:05.832290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1c6f58b4-2ff3-42f7-a25a-acc4c8691b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:05.835210 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118c039f5cee424690dc05978e25dfd6', 'request_id': 'req-171e5d1f-d048-47e3-9639-e2eadce59620'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:05.849026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] The token cache is being invalidate because project 118c039f5cee424690dc05978e25dfd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:05.849678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:05.850324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-171e5d1f-d048-47e3-9639-e2eadce59620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:05.856514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1056/2107] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:05 2022] DELETE /identity/v3/projects/118c039f5cee424690dc05978e25dfd6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:05.859851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ace8-34bf-425f-89e3-97ec96c1e010 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.861211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ace8-34bf-425f-89e3-97ec96c1e010 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.861517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ace8-34bf-425f-89e3-97ec96c1e010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.883705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c179ace8-34bf-425f-89e3-97ec96c1e010 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:05.885030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c179ace8-34bf-425f-89e3-97ec96c1e010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:05.913571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f58b4-2ff3-42f7-a25a-acc4c8691b5d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:05.955648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1057/2108] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:05.964732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf834c-4ca5-4055-b7f3-51bff8c1fdac None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:05.965166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf834c-4ca5-4055-b7f3-51bff8c1fdac None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:05.965582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf834c-4ca5-4055-b7f3-51bff8c1fdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:05.987123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:05.992403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cccf834c-4ca5-4055-b7f3-51bff8c1fdac None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:05.995910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f79739-9c04-470f-9905-7060de3cc324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:05.996365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cccf834c-4ca5-4055-b7f3-51bff8c1fdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:05.999763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f79739-9c04-470f-9905-7060de3cc324 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.000417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f79739-9c04-470f-9905-7060de3cc324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.000931 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f79739-9c04-470f-9905-7060de3cc324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.003544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-82f79739-9c04-470f-9905-7060de3cc324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:06.011227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1058/2109] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:06.012378 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf834c-4ca5-4055-b7f3-51bff8c1fdac None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:06.022840 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf834c-4ca5-4055-b7f3-51bff8c1fdac None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:06.028178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cbe32-d26e-4b90-894e-2c5ef40655c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:06.029415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cbe32-d26e-4b90-894e-2c5ef40655c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.029835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cbe32-d26e-4b90-894e-2c5ef40655c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.030117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cbe32-d26e-4b90-894e-2c5ef40655c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.031217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cbe32-d26e-4b90-894e-2c5ef40655c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:06.031217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cbe32-d26e-4b90-894e-2c5ef40655c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.032983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cbe32-d26e-4b90-894e-2c5ef40655c7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.050505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1059/2110] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:06.051614 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cbe32-d26e-4b90-894e-2c5ef40655c7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:06.064186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cbe32-d26e-4b90-894e-2c5ef40655c7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:06.069698 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83d07-aaeb-4241-a158-83ce37d5b1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:06.070520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83d07-aaeb-4241-a158-83ce37d5b1bd admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.070861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83d07-aaeb-4241-a158-83ce37d5b1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.071090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83d07-aaeb-4241-a158-83ce37d5b1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.071776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c83d07-aaeb-4241-a158-83ce37d5b1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.073898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c83d07-aaeb-4241-a158-83ce37d5b1bd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.093603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f79739-9c04-470f-9905-7060de3cc324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.095625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f79739-9c04-470f-9905-7060de3cc324 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.107373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1052/2111] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:05:06.110044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1060/2112] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:06 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:06.116386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f79739-9c04-470f-9905-7060de3cc324 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:06.124006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83d07-aaeb-4241-a158-83ce37d5b1bd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:06.126408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-53c83d07-aaeb-4241-a158-83ce37d5b1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:06.132082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f79739-9c04-470f-9905-7060de3cc324 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:06.204041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:06.208669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e24f1-8f55-4d8a-a4f0-917495341aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:06.209705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e24f1-8f55-4d8a-a4f0-917495341aed admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.211806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e24f1-8f55-4d8a-a4f0-917495341aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.212269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e24f1-8f55-4d8a-a4f0-917495341aed admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.213229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e24f1-8f55-4d8a-a4f0-917495341aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.215573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e24f1-8f55-4d8a-a4f0-917495341aed admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.230112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83d07-aaeb-4241-a158-83ce37d5b1bd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:06.248977 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1053/2113] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:06 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:06.249696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:06.250476 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e24f1-8f55-4d8a-a4f0-917495341aed admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:06.251135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.252296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.252967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] PATH_INFO: `/v3/users/1860d0d5f91a435498745c3fcb54c7e8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.253465 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-be7e24f1-8f55-4d8a-a4f0-917495341aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:06.254735 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1860d0d5f91a435498745c3fcb54c7e8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.257089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.269826 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e24f1-8f55-4d8a-a4f0-917495341aed admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:06.276063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:06.277319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.278290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.278845 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] PATH_INFO: `/v3/users/763cbd51b7ad4a3ab6eed63b4dbbb28a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.281065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=763cbd51b7ad4a3ab6eed63b4dbbb28a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.283101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.323378 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1860d0d5f91a435498745c3fcb54c7e8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:06.324179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1860d0d5f91a435498745c3fcb54c7e8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:06.338189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1860d0d5f91a435498745c3fcb54c7e8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:06.343615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763cbd51b7ad4a3ab6eed63b4dbbb28a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:06.348146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1860d0d5f91a435498745c3fcb54c7e8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:06.349261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1860d0d5f91a435498745c3fcb54c7e8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:06.353871 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763cbd51b7ad4a3ab6eed63b4dbbb28a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:06.354793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763cbd51b7ad4a3ab6eed63b4dbbb28a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:06.355766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763cbd51b7ad4a3ab6eed63b4dbbb28a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:06.365937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bf9fc6f9-be8a-4196-b8d5-52ff0640cd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763cbd51b7ad4a3ab6eed63b4dbbb28a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:06.373939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1061/2114] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:06 2022] DELETE /identity/v3/users/1860d0d5f91a435498745c3fcb54c7e8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:06.375271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:06.378140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:06.396321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1054/2115] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:06 2022] DELETE /identity/v3/users/763cbd51b7ad4a3ab6eed63b4dbbb28a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:06.396321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625d6cf-39eb-4014-b9f0-ea3a73b00832 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.396321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625d6cf-39eb-4014-b9f0-ea3a73b00832 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.396321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625d6cf-39eb-4014-b9f0-ea3a73b00832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.405881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:06.422299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f625d6cf-39eb-4014-b9f0-ea3a73b00832 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:06.424624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f625d6cf-39eb-4014-b9f0-ea3a73b00832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:06.462624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ea41b-79cd-4a86-8ed9-7bb8727d6831 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:06.490088 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1055/2116] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:06.494950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948110-2eca-4446-aa0b-792c61272658 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.495322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948110-2eca-4446-aa0b-792c61272658 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.495680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948110-2eca-4446-aa0b-792c61272658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.520287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3f948110-2eca-4446-aa0b-792c61272658 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:06.521550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3f948110-2eca-4446-aa0b-792c61272658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:06.540368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1056/2117] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:06.540368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f948110-2eca-4446-aa0b-792c61272658 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:06.553340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3f948110-2eca-4446-aa0b-792c61272658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:06.566075 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea6b8a-7364-47fd-864e-bd358360ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:06.567094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea6b8a-7364-47fd-864e-bd358360ea1d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.568031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea6b8a-7364-47fd-864e-bd358360ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.568926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea6b8a-7364-47fd-864e-bd358360ea1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.570430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea6b8a-7364-47fd-864e-bd358360ea1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.572950 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea6b8a-7364-47fd-864e-bd358360ea1d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.585893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1062/2118] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:06.586801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea6b8a-7364-47fd-864e-bd358360ea1d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:06.588589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-85ea6b8a-7364-47fd-864e-bd358360ea1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:06.611101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:06.636195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f948110-2eca-4446-aa0b-792c61272658 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:06.641259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674692eb-2167-4e62-ab1e-19edecec7f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:06.642154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674692eb-2167-4e62-ab1e-19edecec7f98 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.642756 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674692eb-2167-4e62-ab1e-19edecec7f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.643241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674692eb-2167-4e62-ab1e-19edecec7f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.667788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674692eb-2167-4e62-ab1e-19edecec7f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.670319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674692eb-2167-4e62-ab1e-19edecec7f98 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.673161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea6b8a-7364-47fd-864e-bd358360ea1d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:06.678557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db954d-71ea-4c8c-98b8-a5e741e88548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:06.679419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db954d-71ea-4c8c-98b8-a5e741e88548 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.679893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db954d-71ea-4c8c-98b8-a5e741e88548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.680334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db954d-71ea-4c8c-98b8-a5e741e88548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.682206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1057/2119] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:06.683337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674692eb-2167-4e62-ab1e-19edecec7f98 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:06.685447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-674692eb-2167-4e62-ab1e-19edecec7f98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:06.691751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db954d-71ea-4c8c-98b8-a5e741e88548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.693667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db954d-71ea-4c8c-98b8-a5e741e88548 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.705663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1063/2120] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:06.708045 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674692eb-2167-4e62-ab1e-19edecec7f98 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:06.715185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba0cf3-8bfa-4847-af84-a77c41116ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:06.715727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba0cf3-8bfa-4847-af84-a77c41116ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.717821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba0cf3-8bfa-4847-af84-a77c41116ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.718105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba0cf3-8bfa-4847-af84-a77c41116ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.718770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba0cf3-8bfa-4847-af84-a77c41116ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.720436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba0cf3-8bfa-4847-af84-a77c41116ddb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.740857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1058/2121] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:06.741599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db954d-71ea-4c8c-98b8-a5e741e88548 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:06.752065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db954d-71ea-4c8c-98b8-a5e741e88548 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:06.757349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b28ab-a7fc-45cd-a645-750a992f0091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:06.758096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b28ab-a7fc-45cd-a645-750a992f0091 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.758467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b28ab-a7fc-45cd-a645-750a992f0091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.758857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b28ab-a7fc-45cd-a645-750a992f0091 admin admin] PATH_INFO: `/v3/projects/287ea128b4d247df8e7c7b813d40fec2/users/85cf815561a34845ba5c9d11aacc388b/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.780921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b28ab-a7fc-45cd-a645-750a992f0091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=287ea128b4d247df8e7c7b813d40fec2, user_id=85cf815561a34845ba5c9d11aacc388b, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:06.784093 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b28ab-a7fc-45cd-a645-750a992f0091 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:06.813941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1064/2122] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:06 2022] PUT /identity/v3/projects/287ea128b4d247df8e7c7b813d40fec2/users/85cf815561a34845ba5c9d11aacc388b/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:06.816333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b988ce2-9ea2-4553-a184-20f5d0666b1c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:06.816627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b988ce2-9ea2-4553-a184-20f5d0666b1c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:06.816950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b988ce2-9ea2-4553-a184-20f5d0666b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:06.848593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4b988ce2-9ea2-4553-a184-20f5d0666b1c None None] MFA Rules not processed for user `85cf815561a34845ba5c9d11aacc388b`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:06.852571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4b988ce2-9ea2-4553-a184-20f5d0666b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:06.956936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1059/2123] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:06.961783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b28ab-a7fc-45cd-a645-750a992f0091 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.074791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b28ab-a7fc-45cd-a645-750a992f0091 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:07.080872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d779b-880b-4dd4-8d0d-765bc20afaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:07.081509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d779b-880b-4dd4-8d0d-765bc20afaba admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.081791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d779b-880b-4dd4-8d0d-765bc20afaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.082218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d779b-880b-4dd4-8d0d-765bc20afaba admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.082909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d779b-880b-4dd4-8d0d-765bc20afaba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:07.084857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d779b-880b-4dd4-8d0d-765bc20afaba admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:07.131467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1065/2124] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:06 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:07.135355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b988ce2-9ea2-4553-a184-20f5d0666b1c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.147258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b988ce2-9ea2-4553-a184-20f5d0666b1c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:07.176795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:07.195848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d779b-880b-4dd4-8d0d-765bc20afaba admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.197852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-424d779b-880b-4dd4-8d0d-765bc20afaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:07.228036 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61622-f3cd-4a8e-be82-38ca2003a658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:07.228820 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61622-f3cd-4a8e-be82-38ca2003a658 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.229194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61622-f3cd-4a8e-be82-38ca2003a658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.229957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61622-f3cd-4a8e-be82-38ca2003a658 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.230366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61622-f3cd-4a8e-be82-38ca2003a658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:07.232383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61622-f3cd-4a8e-be82-38ca2003a658 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:07.258141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1060/2125] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:07 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:07.262319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61622-f3cd-4a8e-be82-38ca2003a658 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.276260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61622-f3cd-4a8e-be82-38ca2003a658 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:07.276874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d779b-880b-4dd4-8d0d-765bc20afaba admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:07.286394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:07.287750 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.287939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43089-5c8b-4a98-83c5-d6a7d5be4d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:07.288163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.288542 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] PATH_INFO: `/v3/projects/ae6d44662d074c8e8d7fcc7674b0e85a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.290045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6d44662d074c8e8d7fcc7674b0e85a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:07.291175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43089-5c8b-4a98-83c5-d6a7d5be4d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.291620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43089-5c8b-4a98-83c5-d6a7d5be4d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.292045 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d43089-5c8b-4a98-83c5-d6a7d5be4d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.294444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:07.295046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d43089-5c8b-4a98-83c5-d6a7d5be4d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:07.297349 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d43089-5c8b-4a98-83c5-d6a7d5be4d8d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:07.309067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1061/2126] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:05:07.314126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:07.314489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43089-5c8b-4a98-83c5-d6a7d5be4d8d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.346496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d43089-5c8b-4a98-83c5-d6a7d5be4d8d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:07.370963 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6d44662d074c8e8d7fcc7674b0e85a', 'request_id': 'req-ffb07944-e1e5-435e-8044-81ad3011067f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.384324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6d44662d074c8e8d7fcc7674b0e85a', 'request_id': 'req-ffb07944-e1e5-435e-8044-81ad3011067f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.398367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6d44662d074c8e8d7fcc7674b0e85a', 'request_id': 'req-ffb07944-e1e5-435e-8044-81ad3011067f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.415272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] The token cache is being invalidate because project ae6d44662d074c8e8d7fcc7674b0e85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:07.415910 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.417260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.423805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1066/2127] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:07 2022] DELETE /identity/v3/projects/ae6d44662d074c8e8d7fcc7674b0e85a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:07.423805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.424070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:07.436750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bcff0-40ff-423c-9829-7bc0f31e87f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:07.437627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bcff0-40ff-423c-9829-7bc0f31e87f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.438175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bcff0-40ff-423c-9829-7bc0f31e87f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.438551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bcff0-40ff-423c-9829-7bc0f31e87f5 admin admin] PATH_INFO: `/v3/projects/0ed35f6309f84999ac97fa7353c104ba/users/5cfc0c9eb7e1459c913fefc9e6e6e16c/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.458395 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bcff0-40ff-423c-9829-7bc0f31e87f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed35f6309f84999ac97fa7353c104ba, user_id=5cfc0c9eb7e1459c913fefc9e6e6e16c, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:07.462005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883bcff0-40ff-423c-9829-7bc0f31e87f5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:07.482899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1062/2128] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:07 2022] PUT /identity/v3/projects/0ed35f6309f84999ac97fa7353c104ba/users/5cfc0c9eb7e1459c913fefc9e6e6e16c/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:07.485380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bcff0-40ff-423c-9829-7bc0f31e87f5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.489519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-883bcff0-40ff-423c-9829-7bc0f31e87f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:07.508118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb07944-e1e5-435e-8044-81ad3011067f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:07.600925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:07.601680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.602213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.602498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] PATH_INFO: `/v3/projects/67d63120429e44e1a5703ac078d07733` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.603688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d63120429e44e1a5703ac078d07733)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:07.605655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:07.609467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bcff0-40ff-423c-9829-7bc0f31e87f5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:07.616104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:07.616822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.617137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.617376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] PATH_INFO: `/v3/users/a34e6e6230d143c68f235e5fdf13e41a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.618559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34e6e6230d143c68f235e5fdf13e41a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:07.620987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:07.655858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:07.677739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d63120429e44e1a5703ac078d07733', 'request_id': 'req-f768efc8-897a-4cd1-b0b8-d61541a1efb4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.680838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:07.688698 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d63120429e44e1a5703ac078d07733', 'request_id': 'req-f768efc8-897a-4cd1-b0b8-d61541a1efb4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.689682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34e6e6230d143c68f235e5fdf13e41a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.697203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d63120429e44e1a5703ac078d07733', 'request_id': 'req-f768efc8-897a-4cd1-b0b8-d61541a1efb4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.699281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34e6e6230d143c68f235e5fdf13e41a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.701695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34e6e6230d143c68f235e5fdf13e41a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.702461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34e6e6230d143c68f235e5fdf13e41a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.710284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e5a670e-a2f0-45b9-b488-7bb631281db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34e6e6230d143c68f235e5fdf13e41a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.711391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] The token cache is being invalidate because project 67d63120429e44e1a5703ac078d07733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:07.711691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.712370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:07.716643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1067/2129] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:07 2022] DELETE /identity/v3/projects/67d63120429e44e1a5703ac078d07733 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:07.718104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.726120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:07.732865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1063/2130] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:07 2022] DELETE /identity/v3/users/a34e6e6230d143c68f235e5fdf13e41a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:07.740641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b72f-d219-4516-9410-013d78248270 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.741183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b72f-d219-4516-9410-013d78248270 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.741549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b72f-d219-4516-9410-013d78248270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.771138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d7a1b72f-d219-4516-9410-013d78248270 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:07.772776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d7a1b72f-d219-4516-9410-013d78248270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:07.842049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768efc8-897a-4cd1-b0b8-d61541a1efb4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:07.871844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1064/2131] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:07.881621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323a5b-4f71-4e08-b36a-c9116ff51eba None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.882068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323a5b-4f71-4e08-b36a-c9116ff51eba None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.882421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323a5b-4f71-4e08-b36a-c9116ff51eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.904137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d0323a5b-4f71-4e08-b36a-c9116ff51eba None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:07.905606 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d0323a5b-4f71-4e08-b36a-c9116ff51eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:07.914854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1065/2132] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:07.922608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0323a5b-4f71-4e08-b36a-c9116ff51eba None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.939475 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0323a5b-4f71-4e08-b36a-c9116ff51eba None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:07.946158 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f160107-e891-4c18-906f-9ae416fadda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:07.946914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f160107-e891-4c18-906f-9ae416fadda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.947200 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f160107-e891-4c18-906f-9ae416fadda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.947479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f160107-e891-4c18-906f-9ae416fadda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.948147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f160107-e891-4c18-906f-9ae416fadda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:07.953732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f160107-e891-4c18-906f-9ae416fadda9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:07.961827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4297ed-2dab-45cb-9335-3d71f0d0032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:07.962462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4297ed-2dab-45cb-9335-3d71f0d0032c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:07.962747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4297ed-2dab-45cb-9335-3d71f0d0032c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:07.963023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4297ed-2dab-45cb-9335-3d71f0d0032c admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:07.963687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4297ed-2dab-45cb-9335-3d71f0d0032c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:07.963992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4297ed-2dab-45cb-9335-3d71f0d0032c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:07.965634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4297ed-2dab-45cb-9335-3d71f0d0032c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:07.971585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1068/2133] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:07.974296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f160107-e891-4c18-906f-9ae416fadda9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.982207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1066/2134] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:07.982966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4297ed-2dab-45cb-9335-3d71f0d0032c admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:07.987273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6f160107-e891-4c18-906f-9ae416fadda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:07.998030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4297ed-2dab-45cb-9335-3d71f0d0032c admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.007555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5adbad-d433-474e-a46c-ed2909b2f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.008406 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5adbad-d433-474e-a46c-ed2909b2f5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.008848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5adbad-d433-474e-a46c-ed2909b2f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.009329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5adbad-d433-474e-a46c-ed2909b2f5ec admin admin] PATH_INFO: `/v3/projects/0ed35f6309f84999ac97fa7353c104ba/users/5cfc0c9eb7e1459c913fefc9e6e6e16c/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.011695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5adbad-d433-474e-a46c-ed2909b2f5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed35f6309f84999ac97fa7353c104ba, user_id=5cfc0c9eb7e1459c913fefc9e6e6e16c, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.013163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f160107-e891-4c18-906f-9ae416fadda9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.014829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5adbad-d433-474e-a46c-ed2909b2f5ec admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.019752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.020932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.021363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.021818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] PATH_INFO: `/v3/users/80b5dab01f7444f493495977db7a57c3` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.023632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80b5dab01f7444f493495977db7a57c3)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.026119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.036325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1067/2135] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:07 2022] PUT /identity/v3/projects/0ed35f6309f84999ac97fa7353c104ba/users/5cfc0c9eb7e1459c913fefc9e6e6e16c/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:08.037362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5adbad-d433-474e-a46c-ed2909b2f5ec admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:08.104150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80b5dab01f7444f493495977db7a57c3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.105423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80b5dab01f7444f493495977db7a57c3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.120243 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5adbad-d433-474e-a46c-ed2909b2f5ec admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.125480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80b5dab01f7444f493495977db7a57c3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.126742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514455d1-3b3a-48d6-ae1c-0db09cb5ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.127569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514455d1-3b3a-48d6-ae1c-0db09cb5ebd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.128031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514455d1-3b3a-48d6-ae1c-0db09cb5ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.128496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514455d1-3b3a-48d6-ae1c-0db09cb5ebd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.129255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514455d1-3b3a-48d6-ae1c-0db09cb5ebd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.131417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514455d1-3b3a-48d6-ae1c-0db09cb5ebd3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.141941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80b5dab01f7444f493495977db7a57c3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.142951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-917b244b-ba8b-41ff-91a6-45e59edf1eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80b5dab01f7444f493495977db7a57c3'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.148588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:08.149775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:08.165634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1069/2136] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:07 2022] DELETE /identity/v3/users/80b5dab01f7444f493495977db7a57c3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:08.167408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8651-ccdc-4a1f-8c34-16d7bfedaeca None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.167986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8651-ccdc-4a1f-8c34-16d7bfedaeca None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.168394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8651-ccdc-4a1f-8c34-16d7bfedaeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.175882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1068/2137] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:08 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:08.177470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb1af7-c240-4823-bf65-e26ddfd8b780 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.177864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb1af7-c240-4823-bf65-e26ddfd8b780 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.178246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb1af7-c240-4823-bf65-e26ddfd8b780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.200080 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-afeb1af7-c240-4823-bf65-e26ddfd8b780 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:08.202071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-afeb1af7-c240-4823-bf65-e26ddfd8b780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:08.210349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f42f8651-ccdc-4a1f-8c34-16d7bfedaeca None None] MFA Rules not processed for user `5cfc0c9eb7e1459c913fefc9e6e6e16c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:08.212721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f42f8651-ccdc-4a1f-8c34-16d7bfedaeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:08.276534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1069/2138] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:08.281852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb1af7-c240-4823-bf65-e26ddfd8b780 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:08.283394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-afeb1af7-c240-4823-bf65-e26ddfd8b780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:08.296897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb1af7-c240-4823-bf65-e26ddfd8b780 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.301734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1070/2139] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:08.303024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f8651-ccdc-4a1f-8c34-16d7bfedaeca None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:08.304629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c52383-a2b3-4842-a1be-318c39115a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.305357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f42f8651-ccdc-4a1f-8c34-16d7bfedaeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:08.306167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c52383-a2b3-4842-a1be-318c39115a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.306662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c52383-a2b3-4842-a1be-318c39115a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.307429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c52383-a2b3-4842-a1be-318c39115a86 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.308609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c52383-a2b3-4842-a1be-318c39115a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.312762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c52383-a2b3-4842-a1be-318c39115a86 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.343164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1070/2140] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:08 2022] POST /identity/v3/users => generated 286 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:08.344581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c52383-a2b3-4842-a1be-318c39115a86 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:08.347786 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-53c52383-a2b3-4842-a1be-318c39115a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:08.396829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f8651-ccdc-4a1f-8c34-16d7bfedaeca None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.411262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ca40d-1114-4fa4-b0d0-0720a370c147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.412127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ca40d-1114-4fa4-b0d0-0720a370c147 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.412834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ca40d-1114-4fa4-b0d0-0720a370c147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.413790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ca40d-1114-4fa4-b0d0-0720a370c147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.425734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ca40d-1114-4fa4-b0d0-0720a370c147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.426081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c52383-a2b3-4842-a1be-318c39115a86 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.428174 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ca40d-1114-4fa4-b0d0-0720a370c147 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.431434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662e131-0d15-4d1e-b401-69188ec7f428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.432307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662e131-0d15-4d1e-b401-69188ec7f428 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.432719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662e131-0d15-4d1e-b401-69188ec7f428 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.433109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662e131-0d15-4d1e-b401-69188ec7f428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.435802 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5662e131-0d15-4d1e-b401-69188ec7f428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:08.446093 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1071/2141] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:08.447930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ca40d-1114-4fa4-b0d0-0720a370c147 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:08.451670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c39ca40d-1114-4fa4-b0d0-0720a370c147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:08.466399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ca40d-1114-4fa4-b0d0-0720a370c147 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.472302 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.473033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.473305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.473583 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] PATH_INFO: `/v3/projects/142b6a3e808942fd8cc867198ecce482` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.475416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142b6a3e808942fd8cc867198ecce482)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.477845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.513764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662e131-0d15-4d1e-b401-69188ec7f428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.516099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662e131-0d15-4d1e-b401-69188ec7f428 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.530190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1071/2142] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:08.531527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662e131-0d15-4d1e-b401-69188ec7f428 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:08.545222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662e131-0d15-4d1e-b401-69188ec7f428 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.557455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142b6a3e808942fd8cc867198ecce482', 'request_id': 'req-c8f4ce32-bbf3-4223-9408-6a5be4048081'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.573835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142b6a3e808942fd8cc867198ecce482', 'request_id': 'req-c8f4ce32-bbf3-4223-9408-6a5be4048081'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.583178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142b6a3e808942fd8cc867198ecce482', 'request_id': 'req-c8f4ce32-bbf3-4223-9408-6a5be4048081'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.590362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:08.614676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] The token cache is being invalidate because project 142b6a3e808942fd8cc867198ecce482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:08.615197 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.616054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.620591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1072/2143] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:08 2022] DELETE /identity/v3/projects/142b6a3e808942fd8cc867198ecce482 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:08.625406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:08.627105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:08.647877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f3db3-a73e-46f6-b94d-ba8087d708a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.648636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f3db3-a73e-46f6-b94d-ba8087d708a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.649188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f3db3-a73e-46f6-b94d-ba8087d708a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.649590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f3db3-a73e-46f6-b94d-ba8087d708a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.650505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f3db3-a73e-46f6-b94d-ba8087d708a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.652214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f3db3-a73e-46f6-b94d-ba8087d708a1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.667998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ce32-bbf3-4223-9408-6a5be4048081 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.681198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.683245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.685380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.685825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] PATH_INFO: `/v3/users/67d682d50c1741c980b22526fd1ecdc0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.691110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1072/2144] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:08.692919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f3db3-a73e-46f6-b94d-ba8087d708a1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:08.693966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d682d50c1741c980b22526fd1ecdc0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.697222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-716f3db3-a73e-46f6-b94d-ba8087d708a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:08.697836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.702444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:08.750594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f3db3-a73e-46f6-b94d-ba8087d708a1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.769526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a4453-52c5-4a77-afdd-71d943f3fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.771915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4453-52c5-4a77-afdd-71d943f3fab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.773742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4453-52c5-4a77-afdd-71d943f3fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.774365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4453-52c5-4a77-afdd-71d943f3fab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.778319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a4453-52c5-4a77-afdd-71d943f3fab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.785168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a4453-52c5-4a77-afdd-71d943f3fab9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.805477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d682d50c1741c980b22526fd1ecdc0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.806585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d682d50c1741c980b22526fd1ecdc0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.827268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1073/2145] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:08.831141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a4453-52c5-4a77-afdd-71d943f3fab9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:08.836281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-194a4453-52c5-4a77-afdd-71d943f3fab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:08.844180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d682d50c1741c980b22526fd1ecdc0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.861235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d682d50c1741c980b22526fd1ecdc0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.863561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f832ae2c-e116-4e45-9572-07ee4895e086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d682d50c1741c980b22526fd1ecdc0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:08.877885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a4453-52c5-4a77-afdd-71d943f3fab9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:08.885137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5891045-f286-45a6-b394-5dbb9290e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:08.887032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891045-f286-45a6-b394-5dbb9290e7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.887161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1073/2146] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:08 2022] DELETE /identity/v3/users/67d682d50c1741c980b22526fd1ecdc0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:08.887373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891045-f286-45a6-b394-5dbb9290e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.888648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891045-f286-45a6-b394-5dbb9290e7cc admin admin] PATH_INFO: `/v3/projects/4609f644371d4e20915d2c375d1ad256/users/3cfcc8015015404087f3c4ff8b8839be/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:08.913803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5891045-f286-45a6-b394-5dbb9290e7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4609f644371d4e20915d2c375d1ad256, user_id=3cfcc8015015404087f3c4ff8b8839be, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:08.917905 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5891045-f286-45a6-b394-5dbb9290e7cc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:08.947615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1074/2147] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:08 2022] PUT /identity/v3/projects/4609f644371d4e20915d2c375d1ad256/users/3cfcc8015015404087f3c4ff8b8839be/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:08.959246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5a31-3d38-4b6d-9778-c640bcc820d6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:08.960499 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5a31-3d38-4b6d-9778-c640bcc820d6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:08.960499 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5a31-3d38-4b6d-9778-c640bcc820d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.017484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6bdf5a31-3d38-4b6d-9778-c640bcc820d6 None None] MFA Rules not processed for user `3cfcc8015015404087f3c4ff8b8839be`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:09.019238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6bdf5a31-3d38-4b6d-9778-c640bcc820d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:09.095260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5891045-f286-45a6-b394-5dbb9290e7cc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:09.098295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b5891045-f286-45a6-b394-5dbb9290e7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:09.164500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1074/2148] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:09.175186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf5a31-3d38-4b6d-9778-c640bcc820d6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:09.176957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6bdf5a31-3d38-4b6d-9778-c640bcc820d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:09.237636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5891045-f286-45a6-b394-5dbb9290e7cc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:09.245071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:09.245840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.246201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.246489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] PATH_INFO: `/v3/projects/4bfa495caf7e405d811e89de1d06f9be` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.248207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfa495caf7e405d811e89de1d06f9be)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:09.250414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:09.264803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf5a31-3d38-4b6d-9778-c640bcc820d6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:09.270424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a7443-4613-4ed4-a33f-099de89e95fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a710cfeadd004a8bbf932f6bb3b211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:09.271777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a7443-4613-4ed4-a33f-099de89e95fe service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.272237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a7443-4613-4ed4-a33f-099de89e95fe service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.273644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a7443-4613-4ed4-a33f-099de89e95fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.287758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a7443-4613-4ed4-a33f-099de89e95fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:09.289224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a7443-4613-4ed4-a33f-099de89e95fe service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:09.299674 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1075/2149] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:05:09.306938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfa495caf7e405d811e89de1d06f9be', 'request_id': 'req-d3638a5e-5219-486d-9341-a08304a38649'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:09.314481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfa495caf7e405d811e89de1d06f9be', 'request_id': 'req-d3638a5e-5219-486d-9341-a08304a38649'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:09.335945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfa495caf7e405d811e89de1d06f9be', 'request_id': 'req-d3638a5e-5219-486d-9341-a08304a38649'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:09.354402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] The token cache is being invalidate because project 4bfa495caf7e405d811e89de1d06f9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:09.354705 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:09.355513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3638a5e-5219-486d-9341-a08304a38649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:09.360491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1075/2150] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:09 2022] DELETE /identity/v3/projects/4bfa495caf7e405d811e89de1d06f9be => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:09.363411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b9dc7-814e-4795-bb34-c7b2841ba65c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.364000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b9dc7-814e-4795-bb34-c7b2841ba65c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.364441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b9dc7-814e-4795-bb34-c7b2841ba65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.394085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-856b9dc7-814e-4795-bb34-c7b2841ba65c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:09.395757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-856b9dc7-814e-4795-bb34-c7b2841ba65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:09.420440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:09.538569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1076/2151] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:09.540090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293eac9-b28e-4f63-92aa-aedc85d576c4 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.540629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293eac9-b28e-4f63-92aa-aedc85d576c4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.540999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293eac9-b28e-4f63-92aa-aedc85d576c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.585544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b293eac9-b28e-4f63-92aa-aedc85d576c4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:09.586838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b293eac9-b28e-4f63-92aa-aedc85d576c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:09.599654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1076/2152] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:09.600915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b9dc7-814e-4795-bb34-c7b2841ba65c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:09.613623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b9dc7-814e-4795-bb34-c7b2841ba65c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:09.621903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfbe5d-6047-4165-b63f-2f9d084b19e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:09.624122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfbe5d-6047-4165-b63f-2f9d084b19e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.627047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfbe5d-6047-4165-b63f-2f9d084b19e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.627047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfbe5d-6047-4165-b63f-2f9d084b19e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.627047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfbe5d-6047-4165-b63f-2f9d084b19e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:09.627047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfbe5d-6047-4165-b63f-2f9d084b19e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:09.627894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfbe5d-6047-4165-b63f-2f9d084b19e4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:09.628399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293eac9-b28e-4f63-92aa-aedc85d576c4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:09.629940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b293eac9-b28e-4f63-92aa-aedc85d576c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:09.648699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1077/2153] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:09.650247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293eac9-b28e-4f63-92aa-aedc85d576c4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:09.653296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfbe5d-6047-4165-b63f-2f9d084b19e4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:09.658574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:09.659229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.659578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.659859 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] PATH_INFO: `/v3/projects/fa5e3fde19794544b0fea9e8a28f915f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.661281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5e3fde19794544b0fea9e8a28f915f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:09.663377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:09.677026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:09.678251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfbe5d-6047-4165-b63f-2f9d084b19e4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:09.699558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dcefb-61cc-462e-9111-b21ee8fd8b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:09.700213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dcefb-61cc-462e-9111-b21ee8fd8b1d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.700554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dcefb-61cc-462e-9111-b21ee8fd8b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.701674 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dcefb-61cc-462e-9111-b21ee8fd8b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.702357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dcefb-61cc-462e-9111-b21ee8fd8b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:09.704308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dcefb-61cc-462e-9111-b21ee8fd8b1d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:09.751280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5e3fde19794544b0fea9e8a28f915f', 'request_id': 'req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:09.758924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1078/2154] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:09 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:09.759555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5e3fde19794544b0fea9e8a28f915f', 'request_id': 'req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:09.762905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dcefb-61cc-462e-9111-b21ee8fd8b1d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:09.775007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5e3fde19794544b0fea9e8a28f915f', 'request_id': 'req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:09.797851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] The token cache is being invalidate because project fa5e3fde19794544b0fea9e8a28f915f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:09.798156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:09.812560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-29f591c2-a4bd-4caf-9093-f4dfb2cea7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:09.812560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1077/2155] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:09 2022] DELETE /identity/v3/projects/fa5e3fde19794544b0fea9e8a28f915f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:09.812560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902bd5d-76e3-406f-970d-6af378e450d9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.812560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902bd5d-76e3-406f-970d-6af378e450d9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.812560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902bd5d-76e3-406f-970d-6af378e450d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.838250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1902bd5d-76e3-406f-970d-6af378e450d9 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:09.839809 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1902bd5d-76e3-406f-970d-6af378e450d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:09.847591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dcefb-61cc-462e-9111-b21ee8fd8b1d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:09.853090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcc67d-3f41-47ca-b3da-417570eebc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:09.853316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1078/2156] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:09.853710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcc67d-3f41-47ca-b3da-417570eebc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.853996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcc67d-3f41-47ca-b3da-417570eebc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.854276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcc67d-3f41-47ca-b3da-417570eebc79 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.855626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcc67d-3f41-47ca-b3da-417570eebc79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:09.858416 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcc67d-3f41-47ca-b3da-417570eebc79 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:09.867289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b37b0-83be-4ed6-ab9d-c698a4bfa89a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.867628 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b37b0-83be-4ed6-ab9d-c698a4bfa89a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.868048 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b37b0-83be-4ed6-ab9d-c698a4bfa89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.898758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1079/2157] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:09 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:09.899604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcc67d-3f41-47ca-b3da-417570eebc79 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:09.901529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3dbcc67d-3f41-47ca-b3da-417570eebc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:09.914539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9e8b37b0-83be-4ed6-ab9d-c698a4bfa89a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:09.916847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9e8b37b0-83be-4ed6-ab9d-c698a4bfa89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:09.923369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcc67d-3f41-47ca-b3da-417570eebc79 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:09.930789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3f84c-ca96-435e-b655-e15af8a8d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:09.931643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3f84c-ca96-435e-b655-e15af8a8d57f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.932000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3f84c-ca96-435e-b655-e15af8a8d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.932490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3f84c-ca96-435e-b655-e15af8a8d57f admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.933162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3f84c-ca96-435e-b655-e15af8a8d57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:09.933285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1079/2158] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:09.935643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3f84c-ca96-435e-b655-e15af8a8d57f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:09.938440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b37b0-83be-4ed6-ab9d-c698a4bfa89a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:09.959288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1080/2159] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:09.960184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3f84c-ca96-435e-b655-e15af8a8d57f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:09.973197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b37b0-83be-4ed6-ab9d-c698a4bfa89a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:09.979161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3f84c-ca96-435e-b655-e15af8a8d57f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:09.985628 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea9c6-eaa5-4673-8fdd-5f44d273b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:09.985976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea0ab-4249-4658-851f-671baf794028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:09.986090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea0ab-4249-4658-851f-671baf794028 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.986369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea0ab-4249-4658-851f-671baf794028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.986653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea0ab-4249-4658-851f-671baf794028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.986779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea9c6-eaa5-4673-8fdd-5f44d273b085 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:09.987128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea9c6-eaa5-4673-8fdd-5f44d273b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:09.987296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ea0ab-4249-4658-851f-671baf794028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:09.989184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea9c6-eaa5-4673-8fdd-5f44d273b085 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:09.990035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adea9c6-eaa5-4673-8fdd-5f44d273b085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:09.991881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ea0ab-4249-4658-851f-671baf794028 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:10.001132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adea9c6-eaa5-4673-8fdd-5f44d273b085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:10.007352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adea9c6-eaa5-4673-8fdd-5f44d273b085 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:10.008398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1081/2160] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:10.009505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea0ab-4249-4658-851f-671baf794028 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:10.036524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea0ab-4249-4658-851f-671baf794028 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:10.041444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1080/2161] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:10.046062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea9c6-eaa5-4673-8fdd-5f44d273b085 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:10.055187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67932e4a-3026-4490-aea9-de2dc36d75ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:10.059266 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67932e4a-3026-4490-aea9-de2dc36d75ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:10.059709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67932e4a-3026-4490-aea9-de2dc36d75ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:10.060087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67932e4a-3026-4490-aea9-de2dc36d75ad admin admin] PATH_INFO: `/v3/projects/6a136e9a7a304e9385e8a27792326685/users/7608165db362445e82ab26ad984591b0/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:10.065327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea9c6-eaa5-4673-8fdd-5f44d273b085 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:10.086078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913bd1c-d85c-40b5-a4c8-d3bbd3dfaf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:10.086458 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913bd1c-d85c-40b5-a4c8-d3bbd3dfaf57 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:10.086566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913bd1c-d85c-40b5-a4c8-d3bbd3dfaf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:10.086803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913bd1c-d85c-40b5-a4c8-d3bbd3dfaf57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:10.087697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913bd1c-d85c-40b5-a4c8-d3bbd3dfaf57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:10.090011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913bd1c-d85c-40b5-a4c8-d3bbd3dfaf57 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:10.102818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67932e4a-3026-4490-aea9-de2dc36d75ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a136e9a7a304e9385e8a27792326685, user_id=7608165db362445e82ab26ad984591b0, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:10.106218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67932e4a-3026-4490-aea9-de2dc36d75ad admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:10.130642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1082/2162] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:10 2022] PUT /identity/v3/projects/6a136e9a7a304e9385e8a27792326685/users/7608165db362445e82ab26ad984591b0/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:10.157180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da8f39-be52-4f85-9879-4530f78d7f63 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:10.157598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da8f39-be52-4f85-9879-4530f78d7f63 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:10.157971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da8f39-be52-4f85-9879-4530f78d7f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:10.220387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1081/2163] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:10 2022] POST /identity/v3/projects => generated 391 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:10.223965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913bd1c-d85c-40b5-a4c8-d3bbd3dfaf57 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:10.265135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b2da8f39-be52-4f85-9879-4530f78d7f63 None None] MFA Rules not processed for user `7608165db362445e82ab26ad984591b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:10.266360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b2da8f39-be52-4f85-9879-4530f78d7f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:10.310950 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:10.331059 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913bd1c-d85c-40b5-a4c8-d3bbd3dfaf57 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:10.344106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657379-da47-4bb2-9880-ebe8278fcf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:10.345510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657379-da47-4bb2-9880-ebe8278fcf46 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:10.346142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657379-da47-4bb2-9880-ebe8278fcf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:10.346564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657379-da47-4bb2-9880-ebe8278fcf46 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:10.347377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f657379-da47-4bb2-9880-ebe8278fcf46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:10.350219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f657379-da47-4bb2-9880-ebe8278fcf46 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:10.383431 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1082/2164] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:10 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:10.387575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657379-da47-4bb2-9880-ebe8278fcf46 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:10.389731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8f657379-da47-4bb2-9880-ebe8278fcf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:10.429364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1083/2165] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:10.431491 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da8f39-be52-4f85-9879-4530f78d7f63 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:10.451987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da8f39-be52-4f85-9879-4530f78d7f63 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:10.459947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2bd88-a777-43d4-812f-3fbd070b719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:10.460714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2bd88-a777-43d4-812f-3fbd070b719d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:10.461098 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2bd88-a777-43d4-812f-3fbd070b719d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:10.461474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2bd88-a777-43d4-812f-3fbd070b719d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:10.463254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2bd88-a777-43d4-812f-3fbd070b719d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:10.465893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:10.471489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2bd88-a777-43d4-812f-3fbd070b719d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:10.495046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1084/2166] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:10.500284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2bd88-a777-43d4-812f-3fbd070b719d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:10.504252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3be2bd88-a777-43d4-812f-3fbd070b719d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:10.507529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657379-da47-4bb2-9880-ebe8278fcf46 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:10.515550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe85a1e-7ede-4e5a-9465-997ededd1781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:10.516942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe85a1e-7ede-4e5a-9465-997ededd1781 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:10.517245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe85a1e-7ede-4e5a-9465-997ededd1781 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:10.519477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe85a1e-7ede-4e5a-9465-997ededd1781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:10.522587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5fe85a1e-7ede-4e5a-9465-997ededd1781 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:10.531160 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2bd88-a777-43d4-812f-3fbd070b719d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:10.541411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32029c-978b-43e1-9f90-8fcfe058059a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:10.542034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32029c-978b-43e1-9f90-8fcfe058059a service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:10.542319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32029c-978b-43e1-9f90-8fcfe058059a service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:10.542651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32029c-978b-43e1-9f90-8fcfe058059a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:10.554890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32029c-978b-43e1-9f90-8fcfe058059a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:10.556582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32029c-978b-43e1-9f90-8fcfe058059a service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:10.568702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1085/2167] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:10.569654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32029c-978b-43e1-9f90-8fcfe058059a service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:10.582218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32029c-978b-43e1-9f90-8fcfe058059a service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:10.588301 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324fe6c-4b4a-49f1-8fec-a9f185e8e324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:10.589049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324fe6c-4b4a-49f1-8fec-a9f185e8e324 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:10.589407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324fe6c-4b4a-49f1-8fec-a9f185e8e324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:10.589751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324fe6c-4b4a-49f1-8fec-a9f185e8e324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:10.590469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324fe6c-4b4a-49f1-8fec-a9f185e8e324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:10.593590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324fe6c-4b4a-49f1-8fec-a9f185e8e324 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:10.617265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1086/2168] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:10.618197 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324fe6c-4b4a-49f1-8fec-a9f185e8e324 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:10.631197 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324fe6c-4b4a-49f1-8fec-a9f185e8e324 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:10.638369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846c525-694b-4dd1-a621-ee80ad09a567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:10.639152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846c525-694b-4dd1-a621-ee80ad09a567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:10.639593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846c525-694b-4dd1-a621-ee80ad09a567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:10.639851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846c525-694b-4dd1-a621-ee80ad09a567 admin admin] PATH_INFO: `/v3/projects/9c2fa3c51bf2462f80aaa4b46bd56734/users/bbb19a8ae9cb4d0e8e397fabb68dbe46/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:10.677163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846c525-694b-4dd1-a621-ee80ad09a567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2fa3c51bf2462f80aaa4b46bd56734, user_id=bbb19a8ae9cb4d0e8e397fabb68dbe46, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:10.684515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846c525-694b-4dd1-a621-ee80ad09a567 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:10.698702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe85a1e-7ede-4e5a-9465-997ededd1781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:10.700753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe85a1e-7ede-4e5a-9465-997ededd1781 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:10.723466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1083/2169] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:10.751737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1087/2170] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:10 2022] PUT /identity/v3/projects/9c2fa3c51bf2462f80aaa4b46bd56734/users/bbb19a8ae9cb4d0e8e397fabb68dbe46/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:10.758281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590979c2-124e-42e3-b262-e6741fec9c58 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:10.758393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590979c2-124e-42e3-b262-e6741fec9c58 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:10.759457 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590979c2-124e-42e3-b262-e6741fec9c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:10.846227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-590979c2-124e-42e3-b262-e6741fec9c58 None None] MFA Rules not processed for user `bbb19a8ae9cb4d0e8e397fabb68dbe46`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:10.848875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-590979c2-124e-42e3-b262-e6741fec9c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:10.885526 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846c525-694b-4dd1-a621-ee80ad09a567 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:10.888577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c846c525-694b-4dd1-a621-ee80ad09a567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:10.996593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1084/2171] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:10.997791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590979c2-124e-42e3-b262-e6741fec9c58 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:11.052196 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846c525-694b-4dd1-a621-ee80ad09a567 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:11.058483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:11.060127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.060612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.061231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] PATH_INFO: `/v3/users/3ed9a0e9a6324e59ab983cc0076d7009` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.063956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed9a0e9a6324e59ab983cc0076d7009)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:11.067803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:11.118608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590979c2-124e-42e3-b262-e6741fec9c58 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:11.127685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757c2cc-56c6-4bba-b6b1-50610285fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:11.128540 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757c2cc-56c6-4bba-b6b1-50610285fa1d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.128746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757c2cc-56c6-4bba-b6b1-50610285fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.129151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757c2cc-56c6-4bba-b6b1-50610285fa1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.129908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757c2cc-56c6-4bba-b6b1-50610285fa1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:11.131887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757c2cc-56c6-4bba-b6b1-50610285fa1d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:11.190238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1085/2172] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:10 2022] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:11.191234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757c2cc-56c6-4bba-b6b1-50610285fa1d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:11.193414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9757c2cc-56c6-4bba-b6b1-50610285fa1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:11.218876 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:11.226208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed9a0e9a6324e59ab983cc0076d7009'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.227396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed9a0e9a6324e59ab983cc0076d7009'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.237298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:11.264573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed9a0e9a6324e59ab983cc0076d7009'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.272106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed9a0e9a6324e59ab983cc0076d7009'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.273135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed9a0e9a6324e59ab983cc0076d7009'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.290058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1088/2173] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:10 2022] DELETE /identity/v3/users/3ed9a0e9a6324e59ab983cc0076d7009 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:11.290879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:11.293507 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:11.313322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757c2cc-56c6-4bba-b6b1-50610285fa1d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:11.369548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3a0b1-86b1-4170-801a-7bc75d5e0c69 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:11.375516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b2bf1-8f46-4ade-b230-864cd8c5652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:11.376131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b2bf1-8f46-4ade-b230-864cd8c5652c admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.376390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:11.376926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b2bf1-8f46-4ade-b230-864cd8c5652c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.376926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b2bf1-8f46-4ade-b230-864cd8c5652c admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.377108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.377338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b2bf1-8f46-4ade-b230-864cd8c5652c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:11.377448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.377645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] PATH_INFO: `/v3/users/28addacbb72f4971acf2b61f904af131` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.378834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28addacbb72f4971acf2b61f904af131)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:11.379263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b2bf1-8f46-4ade-b230-864cd8c5652c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:11.380789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:11.401882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1089/2174] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:11 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:11.403545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e5b05-3b46-4ad8-ab27-a22ce5d721b5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.403545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e5b05-3b46-4ad8-ab27-a22ce5d721b5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.403775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e5b05-3b46-4ad8-ab27-a22ce5d721b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.424285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0b2e5b05-3b46-4ad8-ab27-a22ce5d721b5 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:11.425671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0b2e5b05-3b46-4ad8-ab27-a22ce5d721b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:11.433101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28addacbb72f4971acf2b61f904af131'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.437270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1090/2175] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:11.437270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e5b05-3b46-4ad8-ab27-a22ce5d721b5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:11.445688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e5b05-3b46-4ad8-ab27-a22ce5d721b5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:11.447569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28addacbb72f4971acf2b61f904af131'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.448251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28addacbb72f4971acf2b61f904af131'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.448892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28addacbb72f4971acf2b61f904af131'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.451502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495f4b2-61fd-455d-9d4f-6f19b8de5554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:11.452133 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495f4b2-61fd-455d-9d4f-6f19b8de5554 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.452408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495f4b2-61fd-455d-9d4f-6f19b8de5554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.452973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495f4b2-61fd-455d-9d4f-6f19b8de5554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.453638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495f4b2-61fd-455d-9d4f-6f19b8de5554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:11.455234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495f4b2-61fd-455d-9d4f-6f19b8de5554 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:11.457131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28addacbb72f4971acf2b61f904af131'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.466590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1091/2176] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:11.467430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495f4b2-61fd-455d-9d4f-6f19b8de5554 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:11.469159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b495f4b2-61fd-455d-9d4f-6f19b8de5554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:11.479930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1086/2177] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:11 2022] DELETE /identity/v3/users/28addacbb72f4971acf2b61f904af131 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:11.480774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:11.482875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:11.526436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:11.543108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495f4b2-61fd-455d-9d4f-6f19b8de5554 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:11.567597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3631bf-e9d6-4e5a-95ba-c02db7a3c847 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:11.573329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33b10-d0fb-4827-9a93-9da2996264de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:11.574591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33b10-d0fb-4827-9a93-9da2996264de admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.574880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33b10-d0fb-4827-9a93-9da2996264de admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.575201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33b10-d0fb-4827-9a93-9da2996264de admin admin] PATH_INFO: `/v3/projects/151582c4b89a43159d3d3ece53310448/users/366182ee7fdc40a5898575c4e1af191a/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.594767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f33b10-d0fb-4827-9a93-9da2996264de admin admin] RBAC: Authorizing `identity:create_grant(project_id=151582c4b89a43159d3d3ece53310448, user_id=366182ee7fdc40a5898575c4e1af191a, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:11.599975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f33b10-d0fb-4827-9a93-9da2996264de admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:11.621581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1087/2178] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:11 2022] PUT /identity/v3/projects/151582c4b89a43159d3d3ece53310448/users/366182ee7fdc40a5898575c4e1af191a/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:11.629090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5bfe-15f5-4c4f-a750-a828c81b2c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:11.629315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33b10-d0fb-4827-9a93-9da2996264de admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:11.629963 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5bfe-15f5-4c4f-a750-a828c81b2c85 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.630266 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5bfe-15f5-4c4f-a750-a828c81b2c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.630523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5bfe-15f5-4c4f-a750-a828c81b2c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.632835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f8ae5bfe-15f5-4c4f-a750-a828c81b2c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:11.648048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5bfe-15f5-4c4f-a750-a828c81b2c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:11.649563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5bfe-15f5-4c4f-a750-a828c81b2c85 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:11.655715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:11.670610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1092/2179] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:11.705517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5bfe-15f5-4c4f-a750-a828c81b2c85 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:11.707214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f8ae5bfe-15f5-4c4f-a750-a828c81b2c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:11.708800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33b10-d0fb-4827-9a93-9da2996264de admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:11.714748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89eb2d-56c6-4d03-8adb-039ec6aeccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:11.715502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89eb2d-56c6-4d03-8adb-039ec6aeccca admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.716507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89eb2d-56c6-4d03-8adb-039ec6aeccca admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.716631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89eb2d-56c6-4d03-8adb-039ec6aeccca admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.717444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89eb2d-56c6-4d03-8adb-039ec6aeccca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:11.719399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89eb2d-56c6-4d03-8adb-039ec6aeccca admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:11.730686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5bfe-15f5-4c4f-a750-a828c81b2c85 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:11.738815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:11.741105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1088/2180] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:05:11.746819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89eb2d-56c6-4d03-8adb-039ec6aeccca admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:11.748382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.748668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.749114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] PATH_INFO: `/v3/projects/a1ff68a5c2bf4c5c85c9ed415f710f12` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.750437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ff68a5c2bf4c5c85c9ed415f710f12)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:11.752474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:11.771485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89eb2d-56c6-4d03-8adb-039ec6aeccca admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:11.785530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b71e0b-a9ea-4880-9e90-fab842db1d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:11.786255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71e0b-a9ea-4880-9e90-fab842db1d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.786573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71e0b-a9ea-4880-9e90-fab842db1d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.786975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b71e0b-a9ea-4880-9e90-fab842db1d0f admin admin] PATH_INFO: `/v3/projects/151582c4b89a43159d3d3ece53310448/users/366182ee7fdc40a5898575c4e1af191a/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.788978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b71e0b-a9ea-4880-9e90-fab842db1d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=151582c4b89a43159d3d3ece53310448, user_id=366182ee7fdc40a5898575c4e1af191a, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:11.792567 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b71e0b-a9ea-4880-9e90-fab842db1d0f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:11.805919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1089/2181] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:11 2022] PUT /identity/v3/projects/151582c4b89a43159d3d3ece53310448/users/366182ee7fdc40a5898575c4e1af191a/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:11.816734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53408c1-a31d-482c-be39-5903a60eb7a0 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.817022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53408c1-a31d-482c-be39-5903a60eb7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.817471 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53408c1-a31d-482c-be39-5903a60eb7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.833422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ff68a5c2bf4c5c85c9ed415f710f12', 'request_id': 'req-6dfdd0dc-5881-49c2-bd14-dd1763baec82'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.842959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ff68a5c2bf4c5c85c9ed415f710f12', 'request_id': 'req-6dfdd0dc-5881-49c2-bd14-dd1763baec82'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.850849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ff68a5c2bf4c5c85c9ed415f710f12', 'request_id': 'req-6dfdd0dc-5881-49c2-bd14-dd1763baec82'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.856591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a53408c1-a31d-482c-be39-5903a60eb7a0 None None] MFA Rules not processed for user `366182ee7fdc40a5898575c4e1af191a`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:11.858248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a53408c1-a31d-482c-be39-5903a60eb7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:11.864512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] The token cache is being invalidate because project a1ff68a5c2bf4c5c85c9ed415f710f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:11.864512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.865319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6dfdd0dc-5881-49c2-bd14-dd1763baec82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:11.866896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1093/2182] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:11 2022] DELETE /identity/v3/projects/a1ff68a5c2bf4c5c85c9ed415f710f12 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:11.872153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece65d8-57f5-4b25-848d-f1bc3420f154 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.872545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece65d8-57f5-4b25-848d-f1bc3420f154 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.872897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece65d8-57f5-4b25-848d-f1bc3420f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:11.900909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6ece65d8-57f5-4b25-848d-f1bc3420f154 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:11.902140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6ece65d8-57f5-4b25-848d-f1bc3420f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:11.968421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1090/2183] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:11.976248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53408c1-a31d-482c-be39-5903a60eb7a0 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:11.978246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a53408c1-a31d-482c-be39-5903a60eb7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:11.984321 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1094/2184] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:11.986231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e49a03-efd9-4d52-8814-a653f580f7dc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:11.986231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e49a03-efd9-4d52-8814-a653f580f7dc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:11.986472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e49a03-efd9-4d52-8814-a653f580f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.006467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-71e49a03-efd9-4d52-8814-a653f580f7dc None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:12.007705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-71e49a03-efd9-4d52-8814-a653f580f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:12.016568 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1095/2185] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:12.023333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e49a03-efd9-4d52-8814-a653f580f7dc None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.027739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:12.035701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e49a03-efd9-4d52-8814-a653f580f7dc None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.041856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade12c-46f5-4b8f-b07b-efa4c2ae4b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.042564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade12c-46f5-4b8f-b07b-efa4c2ae4b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.042937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade12c-46f5-4b8f-b07b-efa4c2ae4b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.043215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ade12c-46f5-4b8f-b07b-efa4c2ae4b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.044079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ade12c-46f5-4b8f-b07b-efa4c2ae4b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:12.044347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ade12c-46f5-4b8f-b07b-efa4c2ae4b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.046222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ade12c-46f5-4b8f-b07b-efa4c2ae4b74 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.061660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1096/2186] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 17:05:12.066046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade12c-46f5-4b8f-b07b-efa4c2ae4b74 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.077247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ade12c-46f5-4b8f-b07b-efa4c2ae4b74 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.082269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecbedc-af98-489e-a99c-9b51e1029aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.082931 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbedc-af98-489e-a99c-9b51e1029aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.083247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbedc-af98-489e-a99c-9b51e1029aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.084151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbedc-af98-489e-a99c-9b51e1029aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.084281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecbedc-af98-489e-a99c-9b51e1029aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.086650 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecbedc-af98-489e-a99c-9b51e1029aa3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.097455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53408c1-a31d-482c-be39-5903a60eb7a0 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.102240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f73dc-d145-4d35-a0bd-fa94e6806356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.102875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f73dc-d145-4d35-a0bd-fa94e6806356 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.103134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f73dc-d145-4d35-a0bd-fa94e6806356 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.103406 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f73dc-d145-4d35-a0bd-fa94e6806356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.114644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f73dc-d145-4d35-a0bd-fa94e6806356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.116215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f73dc-d145-4d35-a0bd-fa94e6806356 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.120547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1097/2187] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:12 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:12.120704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecbedc-af98-489e-a99c-9b51e1029aa3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.122795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-abecbedc-af98-489e-a99c-9b51e1029aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:12.130506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1091/2188] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:11 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:05:12.131997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f73dc-d145-4d35-a0bd-fa94e6806356 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.148237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f73dc-d145-4d35-a0bd-fa94e6806356 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.185536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:12.208219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecbedc-af98-489e-a99c-9b51e1029aa3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.214087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.214731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.215195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.215499 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] PATH_INFO: `/v3/projects/321b0dbd7a0b47ad9c215a0fe3c7c486` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.217426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] RBAC: Authorizing `identity:delete_project(project_id=321b0dbd7a0b47ad9c215a0fe3c7c486)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.220138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.244665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1b35-8a81-4325-9c04-40b27d653feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.245366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1b35-8a81-4325-9c04-40b27d653feb admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.245722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1b35-8a81-4325-9c04-40b27d653feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.246305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1b35-8a81-4325-9c04-40b27d653feb admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.247633 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda1b35-8a81-4325-9c04-40b27d653feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.250683 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda1b35-8a81-4325-9c04-40b27d653feb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.277858 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '321b0dbd7a0b47ad9c215a0fe3c7c486', 'request_id': 'req-d2d6f38e-48f7-4dc2-b7ca-421450db804b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:12.282020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1092/2189] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:12 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:12.282020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1b35-8a81-4325-9c04-40b27d653feb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.282020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4cda1b35-8a81-4325-9c04-40b27d653feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:12.290754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '321b0dbd7a0b47ad9c215a0fe3c7c486', 'request_id': 'req-d2d6f38e-48f7-4dc2-b7ca-421450db804b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:12.299007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '321b0dbd7a0b47ad9c215a0fe3c7c486', 'request_id': 'req-d2d6f38e-48f7-4dc2-b7ca-421450db804b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:12.313943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] The token cache is being invalidate because project 321b0dbd7a0b47ad9c215a0fe3c7c486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:12.314424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:12.315155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:12.316853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1098/2190] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:12 2022] DELETE /identity/v3/projects/321b0dbd7a0b47ad9c215a0fe3c7c486 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:12.321135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.322509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:12.354954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1b35-8a81-4325-9c04-40b27d653feb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.410814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edcec2f-b253-4d33-9c39-559696da4f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.411569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcec2f-b253-4d33-9c39-559696da4f98 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.411843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcec2f-b253-4d33-9c39-559696da4f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.411974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edcec2f-b253-4d33-9c39-559696da4f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.413924 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0edcec2f-b253-4d33-9c39-559696da4f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:12.422069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6f38e-48f7-4dc2-b7ca-421450db804b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.428571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e415e1c-019f-4eaf-abe7-f503777d6b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.429375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e415e1c-019f-4eaf-abe7-f503777d6b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.430046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e415e1c-019f-4eaf-abe7-f503777d6b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.430334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e415e1c-019f-4eaf-abe7-f503777d6b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.431170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e415e1c-019f-4eaf-abe7-f503777d6b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.432962 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e415e1c-019f-4eaf-abe7-f503777d6b13 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.453070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1099/2191] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:12.460559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c9fe3-f6ca-407f-a04b-c9b7182d7be0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.460559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c9fe3-f6ca-407f-a04b-c9b7182d7be0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.460559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c9fe3-f6ca-407f-a04b-c9b7182d7be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.468508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:12.486022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b51c9fe3-f6ca-407f-a04b-c9b7182d7be0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:12.504218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b51c9fe3-f6ca-407f-a04b-c9b7182d7be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:12.511619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1100/2192] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:12.513091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c9fe3-f6ca-407f-a04b-c9b7182d7be0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.514759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcec2f-b253-4d33-9c39-559696da4f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.516660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edcec2f-b253-4d33-9c39-559696da4f98 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.525217 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c9fe3-f6ca-407f-a04b-c9b7182d7be0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.528644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1093/2193] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:12.530917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435d73-1281-43cb-96a3-3fbb3a0c7f56 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.531300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435d73-1281-43cb-96a3-3fbb3a0c7f56 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.531818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435d73-1281-43cb-96a3-3fbb3a0c7f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.540937 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7d91-e4e3-45a8-8fcc-1755aadc2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.541643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7d91-e4e3-45a8-8fcc-1755aadc2079 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.541946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7d91-e4e3-45a8-8fcc-1755aadc2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.542228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7d91-e4e3-45a8-8fcc-1755aadc2079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.549470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7d91-e4e3-45a8-8fcc-1755aadc2079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.551760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7d91-e4e3-45a8-8fcc-1755aadc2079 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.557001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5d435d73-1281-43cb-96a3-3fbb3a0c7f56 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:12.558233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5d435d73-1281-43cb-96a3-3fbb3a0c7f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:12.569096 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1101/2194] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:12.570406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7d91-e4e3-45a8-8fcc-1755aadc2079 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.574104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1094/2195] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:12.576376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435d73-1281-43cb-96a3-3fbb3a0c7f56 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.582961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7d91-e4e3-45a8-8fcc-1755aadc2079 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.587800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aa0bc-ddaf-4d15-b1ea-652f27d834d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.588498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aa0bc-ddaf-4d15-b1ea-652f27d834d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.588778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aa0bc-ddaf-4d15-b1ea-652f27d834d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.589155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aa0bc-ddaf-4d15-b1ea-652f27d834d9 admin admin] PATH_INFO: `/v3/projects/6ad1d65d1eab401ea6e1888aed1b3a32/users/7177f283d8304de19d19230ba2e61084/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.595026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435d73-1281-43cb-96a3-3fbb3a0c7f56 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.601762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a97bd-4985-4818-a1a3-319e0bf0cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.603449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a97bd-4985-4818-a1a3-319e0bf0cca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.603737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a97bd-4985-4818-a1a3-319e0bf0cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.604163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a97bd-4985-4818-a1a3-319e0bf0cca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.605274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a97bd-4985-4818-a1a3-319e0bf0cca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:12.605592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a97bd-4985-4818-a1a3-319e0bf0cca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.607798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a97bd-4985-4818-a1a3-319e0bf0cca4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.619276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aa0bc-ddaf-4d15-b1ea-652f27d834d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad1d65d1eab401ea6e1888aed1b3a32, user_id=7177f283d8304de19d19230ba2e61084, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.623766 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aa0bc-ddaf-4d15-b1ea-652f27d834d9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.626101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1095/2196] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:12.630147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a97bd-4985-4818-a1a3-319e0bf0cca4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.647098 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a97bd-4985-4818-a1a3-319e0bf0cca4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.648645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1102/2197] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:12 2022] PUT /identity/v3/projects/6ad1d65d1eab401ea6e1888aed1b3a32/users/7177f283d8304de19d19230ba2e61084/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:12.656216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f73d8-1a31-4f2a-9d3f-74057773885a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.656600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f73d8-1a31-4f2a-9d3f-74057773885a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.656817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f73d8-1a31-4f2a-9d3f-74057773885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.689888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c41f73d8-1a31-4f2a-9d3f-74057773885a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:12.691897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c41f73d8-1a31-4f2a-9d3f-74057773885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:12.727417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d82461-3a87-4206-80ac-bee12e229378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.728133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82461-3a87-4206-80ac-bee12e229378 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.728599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82461-3a87-4206-80ac-bee12e229378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.728990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d82461-3a87-4206-80ac-bee12e229378 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.729909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d82461-3a87-4206-80ac-bee12e229378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.732496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:12.732808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d82461-3a87-4206-80ac-bee12e229378 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.781791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1096/2198] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:12 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:12.783529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d82461-3a87-4206-80ac-bee12e229378 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.790528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1103/2199] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:12.801487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f73d8-1a31-4f2a-9d3f-74057773885a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.803811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c41f73d8-1a31-4f2a-9d3f-74057773885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:12.895459 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f73d8-1a31-4f2a-9d3f-74057773885a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.896283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d82461-3a87-4206-80ac-bee12e229378 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.902334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf808f4-87ec-4a3a-bdf4-9cf23a7ad2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.903105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf808f4-87ec-4a3a-bdf4-9cf23a7ad2bb admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.904134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf808f4-87ec-4a3a-bdf4-9cf23a7ad2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.904441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf808f4-87ec-4a3a-bdf4-9cf23a7ad2bb admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.905497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf808f4-87ec-4a3a-bdf4-9cf23a7ad2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.907445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf808f4-87ec-4a3a-bdf4-9cf23a7ad2bb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.942793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1097/2200] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:12 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:12.947670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf808f4-87ec-4a3a-bdf4-9cf23a7ad2bb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:12.968667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf808f4-87ec-4a3a-bdf4-9cf23a7ad2bb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:12.978025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08958b1-ea14-4e0e-9183-27a73c8b1892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.978691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08958b1-ea14-4e0e-9183-27a73c8b1892 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.978984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08958b1-ea14-4e0e-9183-27a73c8b1892 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.979265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08958b1-ea14-4e0e-9183-27a73c8b1892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.981429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e0595-bf8b-4615-8fa0-adffc334ecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:12.982851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e0595-bf8b-4615-8fa0-adffc334ecb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:12.983326 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e0595-bf8b-4615-8fa0-adffc334ecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:12.983719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e0595-bf8b-4615-8fa0-adffc334ecb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:12.984837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e0595-bf8b-4615-8fa0-adffc334ecb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.986737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e0595-bf8b-4615-8fa0-adffc334ecb5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:12.989722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08958b1-ea14-4e0e-9183-27a73c8b1892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:12.991221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08958b1-ea14-4e0e-9183-27a73c8b1892 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:13.000650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1098/2201] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:13.002081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e0595-bf8b-4615-8fa0-adffc334ecb5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:13.002996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1104/2202] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:13.017930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e0595-bf8b-4615-8fa0-adffc334ecb5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:13.023637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d66948-f368-45fd-a215-1882effa6815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:13.024430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66948-f368-45fd-a215-1882effa6815 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:13.024798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66948-f368-45fd-a215-1882effa6815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:13.025105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66948-f368-45fd-a215-1882effa6815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:13.025866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d66948-f368-45fd-a215-1882effa6815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:13.027590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d66948-f368-45fd-a215-1882effa6815 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:13.030747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:13.045992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1099/2203] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:05:13.053877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08958b1-ea14-4e0e-9183-27a73c8b1892 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:13.064446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08958b1-ea14-4e0e-9183-27a73c8b1892 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:13.069698 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc060f8-c45f-4b83-ac39-28fefea923dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:13.070796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc060f8-c45f-4b83-ac39-28fefea923dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:13.070796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc060f8-c45f-4b83-ac39-28fefea923dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:13.071372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc060f8-c45f-4b83-ac39-28fefea923dc admin admin] PATH_INFO: `/v3/projects/71746a71b63646c0b1cee9c5bd6f2c06/users/e47911fcfd884ef993fd30fb6549f586/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:13.089342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc060f8-c45f-4b83-ac39-28fefea923dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=71746a71b63646c0b1cee9c5bd6f2c06, user_id=e47911fcfd884ef993fd30fb6549f586, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:13.092874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc060f8-c45f-4b83-ac39-28fefea923dc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:13.114091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1105/2204] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:13 2022] PUT /identity/v3/projects/71746a71b63646c0b1cee9c5bd6f2c06/users/e47911fcfd884ef993fd30fb6549f586/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:13.125113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40ba1-e209-4c38-a764-5bef9e360ed1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:13.125400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40ba1-e209-4c38-a764-5bef9e360ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:13.125679 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40ba1-e209-4c38-a764-5bef9e360ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:13.155940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2ff40ba1-e209-4c38-a764-5bef9e360ed1 None None] MFA Rules not processed for user `e47911fcfd884ef993fd30fb6549f586`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:13.157201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2ff40ba1-e209-4c38-a764-5bef9e360ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:13.231189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1100/2205] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:13.243581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc060f8-c45f-4b83-ac39-28fefea923dc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:13.245613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1bc060f8-c45f-4b83-ac39-28fefea923dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:13.315238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc060f8-c45f-4b83-ac39-28fefea923dc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:13.319051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545378-8e8a-4a83-b546-4ebd071127d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:13.319668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545378-8e8a-4a83-b546-4ebd071127d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:13.319953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545378-8e8a-4a83-b546-4ebd071127d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:13.320251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545378-8e8a-4a83-b546-4ebd071127d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:13.329808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545378-8e8a-4a83-b546-4ebd071127d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:13.333108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545378-8e8a-4a83-b546-4ebd071127d7 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:13.344700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1106/2206] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:15.078491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff40ba1-e209-4c38-a764-5bef9e360ed1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:15.080194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2ff40ba1-e209-4c38-a764-5bef9e360ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:15.212077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff40ba1-e209-4c38-a764-5bef9e360ed1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:15.220666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:15.222011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:15.230432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:15.231325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] PATH_INFO: `/v3/users/85cf815561a34845ba5c9d11aacc388b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:15.238520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cf815561a34845ba5c9d11aacc388b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:15.255026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:15.389997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cf815561a34845ba5c9d11aacc388b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:15.414794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cf815561a34845ba5c9d11aacc388b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:15.416095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cf815561a34845ba5c9d11aacc388b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:15.419951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cf815561a34845ba5c9d11aacc388b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:15.435499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cf815561a34845ba5c9d11aacc388b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:15.459821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1101/2207] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:15 2022] DELETE /identity/v3/users/85cf815561a34845ba5c9d11aacc388b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:15.464904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b105f-8a81-44ac-a73c-3f1b0655c940 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:15.465468 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b105f-8a81-44ac-a73c-3f1b0655c940 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:15.465824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b105f-8a81-44ac-a73c-3f1b0655c940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:15.478002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:15.515637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7b8b105f-8a81-44ac-a73c-3f1b0655c940 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:15.517269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7b8b105f-8a81-44ac-a73c-3f1b0655c940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:15.604222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1107/2208] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:15.617360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:15.620102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:15.638037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:15.710749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a570bbd-6044-4f8a-b7a4-8437407d0099 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:15.715321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d74c0-74c5-4d84-bee5-c3b29734757c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:15.716698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d74c0-74c5-4d84-bee5-c3b29734757c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:15.717272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d74c0-74c5-4d84-bee5-c3b29734757c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:15.717618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d74c0-74c5-4d84-bee5-c3b29734757c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:15.747154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d74c0-74c5-4d84-bee5-c3b29734757c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:15.748898 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d74c0-74c5-4d84-bee5-c3b29734757c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:15.776893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1102/2209] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:16.139515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b105f-8a81-44ac-a73c-3f1b0655c940 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:16.145564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7b8b105f-8a81-44ac-a73c-3f1b0655c940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:16.168031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b105f-8a81-44ac-a73c-3f1b0655c940 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:16.176993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:16.177999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:16.179068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:16.180043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] PATH_INFO: `/v3/projects/287ea128b4d247df8e7c7b813d40fec2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:16.188236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=287ea128b4d247df8e7c7b813d40fec2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:16.188236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:16.305397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '287ea128b4d247df8e7c7b813d40fec2', 'request_id': 'req-db47cfc6-b3b3-4d12-bb48-691b346b8899'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:16.321469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '287ea128b4d247df8e7c7b813d40fec2', 'request_id': 'req-db47cfc6-b3b3-4d12-bb48-691b346b8899'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:16.333946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '287ea128b4d247df8e7c7b813d40fec2', 'request_id': 'req-db47cfc6-b3b3-4d12-bb48-691b346b8899'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:16.359582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] The token cache is being invalidate because project 287ea128b4d247df8e7c7b813d40fec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:16.359939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:16.362177 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:16.379643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1108/2210] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:16 2022] DELETE /identity/v3/projects/287ea128b4d247df8e7c7b813d40fec2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:16.387306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d74c0-74c5-4d84-bee5-c3b29734757c service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:16.397967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d74c0-74c5-4d84-bee5-c3b29734757c service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:16.560864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:16.561878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:16.562415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:16.563119 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] PATH_INFO: `/v3/users/5cfc0c9eb7e1459c913fefc9e6e6e16c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:16.565420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfc0c9eb7e1459c913fefc9e6e6e16c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:16.568213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:16.687361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfc0c9eb7e1459c913fefc9e6e6e16c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:16.702199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfc0c9eb7e1459c913fefc9e6e6e16c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:16.703140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfc0c9eb7e1459c913fefc9e6e6e16c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:16.703935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfc0c9eb7e1459c913fefc9e6e6e16c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:16.714627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-6a140af1-22ad-4291-ad24-1e59375aaba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfc0c9eb7e1459c913fefc9e6e6e16c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:16.727797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:16.729364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:16.754047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47cfc6-b3b3-4d12-bb48-691b346b8899 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:16.767520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1103/2211] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:16 2022] DELETE /identity/v3/users/5cfc0c9eb7e1459c913fefc9e6e6e16c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:16.904359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:16.905687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:16.907099 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:16.907599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] PATH_INFO: `/v3/users/bbb19a8ae9cb4d0e8e397fabb68dbe46` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:16.911376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb19a8ae9cb4d0e8e397fabb68dbe46)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:16.917221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:16.985541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:17.037566 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb19a8ae9cb4d0e8e397fabb68dbe46'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:17.038434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb19a8ae9cb4d0e8e397fabb68dbe46'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:17.079868 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb19a8ae9cb4d0e8e397fabb68dbe46'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:17.089095 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb19a8ae9cb4d0e8e397fabb68dbe46'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:17.090083 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb19a8ae9cb4d0e8e397fabb68dbe46'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:17.150960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1109/2212] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:16 2022] DELETE /identity/v3/users/bbb19a8ae9cb4d0e8e397fabb68dbe46 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:17.155784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a3e0-b057-4794-934d-9b7d40105924 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:17.156550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a3e0-b057-4794-934d-9b7d40105924 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:17.156850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a3e0-b057-4794-934d-9b7d40105924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:17.201044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-78c9a3e0-b057-4794-934d-9b7d40105924 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:17.202455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-78c9a3e0-b057-4794-934d-9b7d40105924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:17.261739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:17.301086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:17.309081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:17.353844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1104/2213] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:17.366746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9a3e0-b057-4794-934d-9b7d40105924 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:17.368850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-78c9a3e0-b057-4794-934d-9b7d40105924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:17.432229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0185cb4-974e-4d81-a8e3-18cfdd2578f0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:17.453059 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9a3e0-b057-4794-934d-9b7d40105924 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:17.464422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a936c4-ec9b-472e-b403-ee99a22d0dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:17.465159 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a936c4-ec9b-472e-b403-ee99a22d0dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:17.466095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a936c4-ec9b-472e-b403-ee99a22d0dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:17.466332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a936c4-ec9b-472e-b403-ee99a22d0dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:17.468283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:17.469136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:17.473435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:17.474473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] PATH_INFO: `/v3/projects/0ed35f6309f84999ac97fa7353c104ba` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:17.476062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed35f6309f84999ac97fa7353c104ba)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:17.478656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a936c4-ec9b-472e-b403-ee99a22d0dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:17.480376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a936c4-ec9b-472e-b403-ee99a22d0dc9 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:17.481994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:17.492957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1105/2214] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:05:17.686013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed35f6309f84999ac97fa7353c104ba', 'request_id': 'req-9843157a-7cee-4712-a38b-696bdefff170'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:17.700837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed35f6309f84999ac97fa7353c104ba', 'request_id': 'req-9843157a-7cee-4712-a38b-696bdefff170'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:17.720335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed35f6309f84999ac97fa7353c104ba', 'request_id': 'req-9843157a-7cee-4712-a38b-696bdefff170'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:17.754536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] The token cache is being invalidate because project 0ed35f6309f84999ac97fa7353c104ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:17.755479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:17.761461 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9843157a-7cee-4712-a38b-696bdefff170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:17.770549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1110/2215] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:17 2022] DELETE /identity/v3/projects/0ed35f6309f84999ac97fa7353c104ba => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:17.771742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190c171-2a29-4f0d-9b20-f79239514511 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:17.772035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190c171-2a29-4f0d-9b20-f79239514511 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:17.772314 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190c171-2a29-4f0d-9b20-f79239514511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:17.815228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b190c171-2a29-4f0d-9b20-f79239514511 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:17.816668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b190c171-2a29-4f0d-9b20-f79239514511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:17.953741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1106/2216] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:17.962457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021a3c0-dda8-46a9-8cda-0524cc620d62 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:17.962740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021a3c0-dda8-46a9-8cda-0524cc620d62 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:17.963013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021a3c0-dda8-46a9-8cda-0524cc620d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:17.986648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f021a3c0-dda8-46a9-8cda-0524cc620d62 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:17.987887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f021a3c0-dda8-46a9-8cda-0524cc620d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:17.996316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1111/2217] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:18.001267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190c171-2a29-4f0d-9b20-f79239514511 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:18.012569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190c171-2a29-4f0d-9b20-f79239514511 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:18.017262 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd78c8-1bec-4349-b596-70baf920864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:18.018005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd78c8-1bec-4349-b596-70baf920864a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.018285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd78c8-1bec-4349-b596-70baf920864a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.018603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd78c8-1bec-4349-b596-70baf920864a admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.019290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd78c8-1bec-4349-b596-70baf920864a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:18.020058 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd78c8-1bec-4349-b596-70baf920864a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:18.021221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd78c8-1bec-4349-b596-70baf920864a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:18.036394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1107/2218] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:18.046932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021a3c0-dda8-46a9-8cda-0524cc620d62 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:18.064970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021a3c0-dda8-46a9-8cda-0524cc620d62 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:18.071241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e9c6d-abc4-4ade-a6bc-0b2915ea8510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:18.072115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e9c6d-abc4-4ade-a6bc-0b2915ea8510 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.072393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e9c6d-abc4-4ade-a6bc-0b2915ea8510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.072851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e9c6d-abc4-4ade-a6bc-0b2915ea8510 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.073618 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e9c6d-abc4-4ade-a6bc-0b2915ea8510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:18.075852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e9c6d-abc4-4ade-a6bc-0b2915ea8510 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:18.115472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1112/2219] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:18 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:18.116951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd78c8-1bec-4349-b596-70baf920864a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:18.133304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd78c8-1bec-4349-b596-70baf920864a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:18.220116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44186af6-58d3-4444-aca3-82618e74b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:18.220813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186af6-58d3-4444-aca3-82618e74b6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.221097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186af6-58d3-4444-aca3-82618e74b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.221430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186af6-58d3-4444-aca3-82618e74b6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.222077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44186af6-58d3-4444-aca3-82618e74b6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:18.224086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44186af6-58d3-4444-aca3-82618e74b6d0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:18.238913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:18.250758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e9c6d-abc4-4ade-a6bc-0b2915ea8510 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:18.252571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dc0e9c6d-abc4-4ade-a6bc-0b2915ea8510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:18.265521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e9c6d-abc4-4ade-a6bc-0b2915ea8510 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:18.268827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1108/2220] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:18 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:18.270100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44186af6-58d3-4444-aca3-82618e74b6d0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:18.274552 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:18.275742 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.276237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.276744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] PATH_INFO: `/v3/projects/9c2fa3c51bf2462f80aaa4b46bd56734` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.278706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2fa3c51bf2462f80aaa4b46bd56734)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:18.280884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:18.283752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:18.285725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44186af6-58d3-4444-aca3-82618e74b6d0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:18.291316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076971d-c7c6-47bd-b1b9-f103e4d28ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:18.292024 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076971d-c7c6-47bd-b1b9-f103e4d28ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.292376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076971d-c7c6-47bd-b1b9-f103e4d28ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.292747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076971d-c7c6-47bd-b1b9-f103e4d28ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.293548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076971d-c7c6-47bd-b1b9-f103e4d28ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:18.296475 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076971d-c7c6-47bd-b1b9-f103e4d28ef1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:18.316537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1109/2221] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:18.319255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076971d-c7c6-47bd-b1b9-f103e4d28ef1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:18.338584 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076971d-c7c6-47bd-b1b9-f103e4d28ef1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:18.347009 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc064ac-5b65-446f-a019-57cff59c03cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:18.348310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc064ac-5b65-446f-a019-57cff59c03cd admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.349059 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc064ac-5b65-446f-a019-57cff59c03cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.349697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc064ac-5b65-446f-a019-57cff59c03cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.350667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc064ac-5b65-446f-a019-57cff59c03cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:18.354790 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc064ac-5b65-446f-a019-57cff59c03cd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:18.360526 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2fa3c51bf2462f80aaa4b46bd56734', 'request_id': 'req-15b71484-2983-4420-8a64-ea3ed9398e2b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:18.373949 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2fa3c51bf2462f80aaa4b46bd56734', 'request_id': 'req-15b71484-2983-4420-8a64-ea3ed9398e2b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:18.377007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1110/2222] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:18.379835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc064ac-5b65-446f-a019-57cff59c03cd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:18.388141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2fa3c51bf2462f80aaa4b46bd56734', 'request_id': 'req-15b71484-2983-4420-8a64-ea3ed9398e2b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:18.397829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc064ac-5b65-446f-a019-57cff59c03cd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:18.405453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] The token cache is being invalidate because project 9c2fa3c51bf2462f80aaa4b46bd56734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:18.405826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:18.406626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:18.411497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1113/2223] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:18 2022] DELETE /identity/v3/projects/9c2fa3c51bf2462f80aaa4b46bd56734 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:18.425252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:18.428341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:18.526394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d245e5b-3beb-4dac-807c-e518f78e7f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:18.527044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d245e5b-3beb-4dac-807c-e518f78e7f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.527323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d245e5b-3beb-4dac-807c-e518f78e7f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.527602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d245e5b-3beb-4dac-807c-e518f78e7f69 admin admin] PATH_INFO: `/v3/projects/658319adae7543c98960359c02378613/users/fcfa895d5e4f4f0f95e1740897daf0f1/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.541465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b71484-2983-4420-8a64-ea3ed9398e2b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:18.553838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d245e5b-3beb-4dac-807c-e518f78e7f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658319adae7543c98960359c02378613, user_id=fcfa895d5e4f4f0f95e1740897daf0f1, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:18.562287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d245e5b-3beb-4dac-807c-e518f78e7f69 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:18.565478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:18.567332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.568287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.568993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] PATH_INFO: `/v3/users/366182ee7fdc40a5898575c4e1af191a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.570826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=366182ee7fdc40a5898575c4e1af191a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:18.573512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:18.589978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1111/2224] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:18 2022] PUT /identity/v3/projects/658319adae7543c98960359c02378613/users/fcfa895d5e4f4f0f95e1740897daf0f1/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:18.603103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5427b-7f44-4b02-816c-09f7057d02d3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.603654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5427b-7f44-4b02-816c-09f7057d02d3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.603654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5427b-7f44-4b02-816c-09f7057d02d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.637316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-e7e5427b-7f44-4b02-816c-09f7057d02d3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:18.638717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e7e5427b-7f44-4b02-816c-09f7057d02d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:18.663003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366182ee7fdc40a5898575c4e1af191a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:18.664323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366182ee7fdc40a5898575c4e1af191a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:18.692631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366182ee7fdc40a5898575c4e1af191a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:18.706647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366182ee7fdc40a5898575c4e1af191a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:18.712884 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366182ee7fdc40a5898575c4e1af191a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:18.737367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1114/2225] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:18 2022] DELETE /identity/v3/users/366182ee7fdc40a5898575c4e1af191a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:18.766416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1112/2226] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:18.781120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:18.782599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:18.790207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6e04f-2a69-4823-8c7d-2f284f1f57b5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.790503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6e04f-2a69-4823-8c7d-2f284f1f57b5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.790787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6e04f-2a69-4823-8c7d-2f284f1f57b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.799622 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:18.878164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9632d2f-7419-489a-91d0-9c130425ba2d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:18.878679 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-57a6e04f-2a69-4823-8c7d-2f284f1f57b5 None None] MFA Rules not processed for user `7177f283d8304de19d19230ba2e61084`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:18.881149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-57a6e04f-2a69-4823-8c7d-2f284f1f57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:18.882529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791029a-53bc-4a30-8874-6151a2781693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:18.883309 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791029a-53bc-4a30-8874-6151a2781693 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:18.883669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791029a-53bc-4a30-8874-6151a2781693 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:18.884041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791029a-53bc-4a30-8874-6151a2781693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:18.984351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:18.993941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791029a-53bc-4a30-8874-6151a2781693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:18.996599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791029a-53bc-4a30-8874-6151a2781693 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:19.021184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1115/2227] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:19.049550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1113/2228] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:19.054908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6014e5-56bb-45e8-a8f7-b18f55044512 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:19.055195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6014e5-56bb-45e8-a8f7-b18f55044512 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:19.055460 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6014e5-56bb-45e8-a8f7-b18f55044512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:19.081456 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4c6014e5-56bb-45e8-a8f7-b18f55044512 None None] MFA Rules not processed for user `7177f283d8304de19d19230ba2e61084`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:19.082621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4c6014e5-56bb-45e8-a8f7-b18f55044512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:19.097956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1116/2229] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:19.109755 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6e04f-2a69-4823-8c7d-2f284f1f57b5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:19.111369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-57a6e04f-2a69-4823-8c7d-2f284f1f57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:19.211744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6e04f-2a69-4823-8c7d-2f284f1f57b5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:19.220665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041a56d-9d99-440e-86db-113b871d5113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:19.222542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041a56d-9d99-440e-86db-113b871d5113 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:19.223005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041a56d-9d99-440e-86db-113b871d5113 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:19.223439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041a56d-9d99-440e-86db-113b871d5113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:19.237037 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041a56d-9d99-440e-86db-113b871d5113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:19.239026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041a56d-9d99-440e-86db-113b871d5113 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:19.260767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1114/2230] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:19.322414 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6014e5-56bb-45e8-a8f7-b18f55044512 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:19.324355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4c6014e5-56bb-45e8-a8f7-b18f55044512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:19.366609 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6014e5-56bb-45e8-a8f7-b18f55044512 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:19.376941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:19.377805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:19.378259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:19.378769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] PATH_INFO: `/v3/projects/151582c4b89a43159d3d3ece53310448` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:19.380236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=151582c4b89a43159d3d3ece53310448)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:19.382748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:19.443820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151582c4b89a43159d3d3ece53310448', 'request_id': 'req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:19.458222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151582c4b89a43159d3d3ece53310448', 'request_id': 'req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:19.467704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151582c4b89a43159d3d3ece53310448', 'request_id': 'req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:19.497526 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] The token cache is being invalidate because project 151582c4b89a43159d3d3ece53310448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:19.497824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:19.498998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-89aed6fb-d6dd-4b4c-be9f-81d430fa4cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:19.505584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1117/2231] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:19 2022] DELETE /identity/v3/projects/151582c4b89a43159d3d3ece53310448 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:19.507346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b1ac4-520e-4a56-9ff6-c26cdebf0a40 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:19.507889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b1ac4-520e-4a56-9ff6-c26cdebf0a40 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:19.508035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b1ac4-520e-4a56-9ff6-c26cdebf0a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:19.587010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-144b1ac4-520e-4a56-9ff6-c26cdebf0a40 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:19.589601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-144b1ac4-520e-4a56-9ff6-c26cdebf0a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:19.710110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1115/2232] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:19.719068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807eb4a-bf46-4f50-a514-6510cae84d19 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:19.723731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807eb4a-bf46-4f50-a514-6510cae84d19 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:19.723731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807eb4a-bf46-4f50-a514-6510cae84d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:19.771301 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8807eb4a-bf46-4f50-a514-6510cae84d19 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:19.772831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8807eb4a-bf46-4f50-a514-6510cae84d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:19.787451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1118/2233] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:19.794004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b1ac4-520e-4a56-9ff6-c26cdebf0a40 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:19.808095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b1ac4-520e-4a56-9ff6-c26cdebf0a40 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:19.814758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cd1bd-07a5-4a36-b974-eb3fdf78fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:19.815491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cd1bd-07a5-4a36-b974-eb3fdf78fa90 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:19.815822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cd1bd-07a5-4a36-b974-eb3fdf78fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:19.816166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cd1bd-07a5-4a36-b974-eb3fdf78fa90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:19.817160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cd1bd-07a5-4a36-b974-eb3fdf78fa90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:19.817607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cd1bd-07a5-4a36-b974-eb3fdf78fa90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:19.821259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cd1bd-07a5-4a36-b974-eb3fdf78fa90 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:19.837353 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1116/2234] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:19.841657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807eb4a-bf46-4f50-a514-6510cae84d19 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:19.856299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807eb4a-bf46-4f50-a514-6510cae84d19 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:19.860532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bb471-797b-4de0-b85c-580d39cb9e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:19.861163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb471-797b-4de0-b85c-580d39cb9e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:19.861453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb471-797b-4de0-b85c-580d39cb9e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:19.861721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb471-797b-4de0-b85c-580d39cb9e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:19.862374 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bb471-797b-4de0-b85c-580d39cb9e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:19.865796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bb471-797b-4de0-b85c-580d39cb9e5e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:19.902802 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1119/2235] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:19 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:19.907580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cd1bd-07a5-4a36-b974-eb3fdf78fa90 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:19.919537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cd1bd-07a5-4a36-b974-eb3fdf78fa90 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:20.030588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.060045 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac914b44-f0aa-41b6-9257-b1e2233f1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:20.063357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914b44-f0aa-41b6-9257-b1e2233f1099 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.063835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914b44-f0aa-41b6-9257-b1e2233f1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.064306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac914b44-f0aa-41b6-9257-b1e2233f1099 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.066531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac914b44-f0aa-41b6-9257-b1e2233f1099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:20.069223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac914b44-f0aa-41b6-9257-b1e2233f1099 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:20.124649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1117/2236] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:19 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:20.128517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bb471-797b-4de0-b85c-580d39cb9e5e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:20.158205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bb471-797b-4de0-b85c-580d39cb9e5e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:20.177478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a99d1-2dd2-48d1-8b08-25161673ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:20.178187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a99d1-2dd2-48d1-8b08-25161673ae2c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.178473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a99d1-2dd2-48d1-8b08-25161673ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.178744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a99d1-2dd2-48d1-8b08-25161673ae2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.179401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a99d1-2dd2-48d1-8b08-25161673ae2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:20.181056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a99d1-2dd2-48d1-8b08-25161673ae2c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:20.187262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.203498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac914b44-f0aa-41b6-9257-b1e2233f1099 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:20.215081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1120/2237] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:20.226258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac914b44-f0aa-41b6-9257-b1e2233f1099 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:20.240139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7b5f3-a18c-4f1d-a2f4-02680a105f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:20.241225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b5f3-a18c-4f1d-a2f4-02680a105f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.241225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b5f3-a18c-4f1d-a2f4-02680a105f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.245737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b5f3-a18c-4f1d-a2f4-02680a105f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.246554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7b5f3-a18c-4f1d-a2f4-02680a105f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:20.248302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7b5f3-a18c-4f1d-a2f4-02680a105f54 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:20.271232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1118/2238] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:20.275836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a99d1-2dd2-48d1-8b08-25161673ae2c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:20.290969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a99d1-2dd2-48d1-8b08-25161673ae2c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:20.302743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27973833-7a99-44b0-8e8c-c138944cfca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:20.303722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27973833-7a99-44b0-8e8c-c138944cfca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.303991 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27973833-7a99-44b0-8e8c-c138944cfca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.304494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27973833-7a99-44b0-8e8c-c138944cfca2 admin admin] PATH_INFO: `/v3/projects/76d21befa9f54fae807f97766de7db72/users/596bdaef828a4d879b3e6dba63d5b68c/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.329895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27973833-7a99-44b0-8e8c-c138944cfca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d21befa9f54fae807f97766de7db72, user_id=596bdaef828a4d879b3e6dba63d5b68c, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:20.333282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27973833-7a99-44b0-8e8c-c138944cfca2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:20.362933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1121/2239] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:20 2022] PUT /identity/v3/projects/76d21befa9f54fae807f97766de7db72/users/596bdaef828a4d879b3e6dba63d5b68c/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:20.376013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e202ae-436b-41d0-9b46-02fbd3266050 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.376656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e202ae-436b-41d0-9b46-02fbd3266050 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.377229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e202ae-436b-41d0-9b46-02fbd3266050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.453920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d7dbd-361a-44f1-9f0b-78db6e9e2319 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.454216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d7dbd-361a-44f1-9f0b-78db6e9e2319 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.454589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d7dbd-361a-44f1-9f0b-78db6e9e2319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.500231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-27e202ae-436b-41d0-9b46-02fbd3266050 None None] MFA Rules not processed for user `596bdaef828a4d879b3e6dba63d5b68c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:20.501915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-27e202ae-436b-41d0-9b46-02fbd3266050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:20.539952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-664d7dbd-361a-44f1-9f0b-78db6e9e2319 None None] MFA Rules not processed for user `fcfa895d5e4f4f0f95e1740897daf0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:20.541773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-664d7dbd-361a-44f1-9f0b-78db6e9e2319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:20.660445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1119/2240] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:20.661547 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e202ae-436b-41d0-9b46-02fbd3266050 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:20.691693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1122/2241] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:20.718305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d7dbd-361a-44f1-9f0b-78db6e9e2319 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:20.725877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-664d7dbd-361a-44f1-9f0b-78db6e9e2319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:20.752667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e202ae-436b-41d0-9b46-02fbd3266050 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:20.780367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e779f58-38cd-4819-ba62-0c628c03307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:20.781077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779f58-38cd-4819-ba62-0c628c03307a admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.781377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779f58-38cd-4819-ba62-0c628c03307a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.781663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779f58-38cd-4819-ba62-0c628c03307a admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.782267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e779f58-38cd-4819-ba62-0c628c03307a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:20.784212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e779f58-38cd-4819-ba62-0c628c03307a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:20.822862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d7dbd-361a-44f1-9f0b-78db6e9e2319 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:20.830728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a9fdd-406a-4e2c-ae56-1519a08928ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:20.833451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a9fdd-406a-4e2c-ae56-1519a08928ca admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.834085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a9fdd-406a-4e2c-ae56-1519a08928ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.834440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a9fdd-406a-4e2c-ae56-1519a08928ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.835161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a9fdd-406a-4e2c-ae56-1519a08928ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:20.837307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a9fdd-406a-4e2c-ae56-1519a08928ca admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:20.838151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1120/2242] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:20 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:20.840623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5b411-cbbf-4b30-8cf3-1c2253c04693 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.841615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5b411-cbbf-4b30-8cf3-1c2253c04693 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.842158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5b411-cbbf-4b30-8cf3-1c2253c04693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.874078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3aa5b411-cbbf-4b30-8cf3-1c2253c04693 None None] MFA Rules not processed for user `7177f283d8304de19d19230ba2e61084`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:20.875301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3aa5b411-cbbf-4b30-8cf3-1c2253c04693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:20.876276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1123/2243] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:20 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:20.877137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a9fdd-406a-4e2c-ae56-1519a08928ca admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:20.928770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.939582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.950846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1121/2244] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:20.951817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5b411-cbbf-4b30-8cf3-1c2253c04693 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:20.960470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a9fdd-406a-4e2c-ae56-1519a08928ca admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:20.965143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5b411-cbbf-4b30-8cf3-1c2253c04693 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:20.967655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140606b-667b-4056-b0fe-fbd938888142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:20.968475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140606b-667b-4056-b0fe-fbd938888142 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.968819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140606b-667b-4056-b0fe-fbd938888142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.969144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140606b-667b-4056-b0fe-fbd938888142 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.969843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140606b-667b-4056-b0fe-fbd938888142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:20.971452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7022031-6f49-4e62-874e-3f7902433bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:20.972142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140606b-667b-4056-b0fe-fbd938888142 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:20.972264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7022031-6f49-4e62-874e-3f7902433bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:20.972589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7022031-6f49-4e62-874e-3f7902433bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:20.972966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7022031-6f49-4e62-874e-3f7902433bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:20.973842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7022031-6f49-4e62-874e-3f7902433bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:20.975972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7022031-6f49-4e62-874e-3f7902433bb8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:21.001524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1124/2245] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:20 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:21.006425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1122/2246] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:20 2022] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:21.011718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7022031-6f49-4e62-874e-3f7902433bb8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:21.015069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140606b-667b-4056-b0fe-fbd938888142 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:21.027793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140606b-667b-4056-b0fe-fbd938888142 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:21.034469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a485fe8-4b7d-4aa6-a422-6ee62a3b7ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:21.040489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a485fe8-4b7d-4aa6-a422-6ee62a3b7ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:21.040968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a485fe8-4b7d-4aa6-a422-6ee62a3b7ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:21.041389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a485fe8-4b7d-4aa6-a422-6ee62a3b7ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:21.041519 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7022031-6f49-4e62-874e-3f7902433bb8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:21.042497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a485fe8-4b7d-4aa6-a422-6ee62a3b7ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:21.045124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a485fe8-4b7d-4aa6-a422-6ee62a3b7ed1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:21.048213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e5ae2-0881-4479-b478-67290b925cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:21.049071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e5ae2-0881-4479-b478-67290b925cbf admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:21.049501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e5ae2-0881-4479-b478-67290b925cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:21.049879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e5ae2-0881-4479-b478-67290b925cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:21.050612 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e5ae2-0881-4479-b478-67290b925cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:21.052608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e5ae2-0881-4479-b478-67290b925cbf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:21.066269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1125/2247] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:21.068335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a485fe8-4b7d-4aa6-a422-6ee62a3b7ed1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:21.077984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1123/2248] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:21.083433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e5ae2-0881-4479-b478-67290b925cbf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:21.083642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a485fe8-4b7d-4aa6-a422-6ee62a3b7ed1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:21.091714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77c14-a5f4-4e1c-9b0e-28b45fcc3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:21.092545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77c14-a5f4-4e1c-9b0e-28b45fcc3895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:21.092824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77c14-a5f4-4e1c-9b0e-28b45fcc3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:21.093205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77c14-a5f4-4e1c-9b0e-28b45fcc3895 admin admin] PATH_INFO: `/v3/projects/1b079cb9057b4a1087937889a5da343b/users/accdd174c118492796ab2ccaf51c15d1/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:21.111327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e5ae2-0881-4479-b478-67290b925cbf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:21.117388 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77c14-a5f4-4e1c-9b0e-28b45fcc3895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b079cb9057b4a1087937889a5da343b, user_id=accdd174c118492796ab2ccaf51c15d1, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:21.121520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77c14-a5f4-4e1c-9b0e-28b45fcc3895 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:21.131274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666425e-698d-4213-b2c5-2c00aa2e452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:21.132242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666425e-698d-4213-b2c5-2c00aa2e452f admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:21.132822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666425e-698d-4213-b2c5-2c00aa2e452f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:21.133208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666425e-698d-4213-b2c5-2c00aa2e452f admin admin] PATH_INFO: `/v3/projects/985a141b0fa54741b62ad288ce963105/users/3aca35b1b0cc49f497b8ba262e574223/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:21.148511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1126/2249] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:21 2022] PUT /identity/v3/projects/1b079cb9057b4a1087937889a5da343b/users/accdd174c118492796ab2ccaf51c15d1/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:21.154003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77c14-a5f4-4e1c-9b0e-28b45fcc3895 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:21.206735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666425e-698d-4213-b2c5-2c00aa2e452f admin admin] RBAC: Authorizing `identity:create_grant(project_id=985a141b0fa54741b62ad288ce963105, user_id=3aca35b1b0cc49f497b8ba262e574223, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:21.209652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666425e-698d-4213-b2c5-2c00aa2e452f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:21.247318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1124/2250] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:21 2022] PUT /identity/v3/projects/985a141b0fa54741b62ad288ce963105/users/3aca35b1b0cc49f497b8ba262e574223/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:21.248406 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666425e-698d-4213-b2c5-2c00aa2e452f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:21.274606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77c14-a5f4-4e1c-9b0e-28b45fcc3895 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:21.360306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f4a9a-4966-490f-958b-0ed6f9911aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:21.368497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4a9a-4966-490f-958b-0ed6f9911aad admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:21.368497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4a9a-4966-490f-958b-0ed6f9911aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:21.368497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f4a9a-4966-490f-958b-0ed6f9911aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:21.368497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f4a9a-4966-490f-958b-0ed6f9911aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:21.372871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f4a9a-4966-490f-958b-0ed6f9911aad admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:21.386372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1127/2251] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:21.391014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f4a9a-4966-490f-958b-0ed6f9911aad admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:21.397857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666425e-698d-4213-b2c5-2c00aa2e452f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:21.407312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27923c4-6e08-4926-953b-8546e9aeec57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:21.407912 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27923c4-6e08-4926-953b-8546e9aeec57 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:21.408190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27923c4-6e08-4926-953b-8546e9aeec57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:21.408545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27923c4-6e08-4926-953b-8546e9aeec57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:21.409268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f4a9a-4966-490f-958b-0ed6f9911aad admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:21.411397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27923c4-6e08-4926-953b-8546e9aeec57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:21.414770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27923c4-6e08-4926-953b-8546e9aeec57 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:21.417526 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100a566-59bc-47da-9dd3-bc281b5d0dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:21.418351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100a566-59bc-47da-9dd3-bc281b5d0dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:21.418758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100a566-59bc-47da-9dd3-bc281b5d0dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:21.419139 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100a566-59bc-47da-9dd3-bc281b5d0dd5 admin admin] PATH_INFO: `/v3/projects/1b079cb9057b4a1087937889a5da343b/users/accdd174c118492796ab2ccaf51c15d1/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:21.428157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100a566-59bc-47da-9dd3-bc281b5d0dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b079cb9057b4a1087937889a5da343b, user_id=accdd174c118492796ab2ccaf51c15d1, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:21.428157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100a566-59bc-47da-9dd3-bc281b5d0dd5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:21.433310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1125/2252] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:21.437916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27923c4-6e08-4926-953b-8546e9aeec57 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:21.441409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1128/2253] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:21 2022] PUT /identity/v3/projects/1b079cb9057b4a1087937889a5da343b/users/accdd174c118492796ab2ccaf51c15d1/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:21.453967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0e25-09b2-4bbc-8c08-4fa30b1c036d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:21.453967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0e25-09b2-4bbc-8c08-4fa30b1c036d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:21.453967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e0e25-09b2-4bbc-8c08-4fa30b1c036d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:21.484192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27923c4-6e08-4926-953b-8546e9aeec57 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:21.535472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-603e0e25-09b2-4bbc-8c08-4fa30b1c036d None None] MFA Rules not processed for user `accdd174c118492796ab2ccaf51c15d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:21.538911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-603e0e25-09b2-4bbc-8c08-4fa30b1c036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:21.595924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:21.597148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e10ac-c657-46c4-a083-d73975b27544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:21.597999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e10ac-c657-46c4-a083-d73975b27544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:21.598390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e10ac-c657-46c4-a083-d73975b27544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:21.599059 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e10ac-c657-46c4-a083-d73975b27544 admin admin] PATH_INFO: `/v3/projects/985a141b0fa54741b62ad288ce963105/users/3aca35b1b0cc49f497b8ba262e574223/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:21.603298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e10ac-c657-46c4-a083-d73975b27544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985a141b0fa54741b62ad288ce963105, user_id=3aca35b1b0cc49f497b8ba262e574223, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:21.616258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e10ac-c657-46c4-a083-d73975b27544 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:21.661860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1126/2254] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:21 2022] PUT /identity/v3/projects/985a141b0fa54741b62ad288ce963105/users/3aca35b1b0cc49f497b8ba262e574223/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:21.705654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1129/2255] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:21.707207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e10ac-c657-46c4-a083-d73975b27544 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:21.709417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-390e10ac-c657-46c4-a083-d73975b27544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:21.763501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:21.818840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e10ac-c657-46c4-a083-d73975b27544 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:21.827279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37028253-b626-4254-8a96-86965e52da64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:21.829371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37028253-b626-4254-8a96-86965e52da64 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:21.829916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37028253-b626-4254-8a96-86965e52da64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:21.831915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37028253-b626-4254-8a96-86965e52da64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:21.979222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37028253-b626-4254-8a96-86965e52da64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:21.980761 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37028253-b626-4254-8a96-86965e52da64 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:22.002488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1127/2256] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:22.220965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e0e25-09b2-4bbc-8c08-4fa30b1c036d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:22.320591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e0e25-09b2-4bbc-8c08-4fa30b1c036d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:22.338222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62967110-6a08-443f-a785-987df721859b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:22.339006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967110-6a08-443f-a785-987df721859b service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:22.341473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967110-6a08-443f-a785-987df721859b service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:22.341873 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967110-6a08-443f-a785-987df721859b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:22.483501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62967110-6a08-443f-a785-987df721859b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:22.485804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62967110-6a08-443f-a785-987df721859b service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:22.501702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1130/2257] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:22.681580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37028253-b626-4254-8a96-86965e52da64 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:22.686891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-37028253-b626-4254-8a96-86965e52da64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:22.787429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37028253-b626-4254-8a96-86965e52da64 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:22.800216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:22.800216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:22.800216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:22.800216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] PATH_INFO: `/v3/users/7608165db362445e82ab26ad984591b0` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:22.800708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7608165db362445e82ab26ad984591b0)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:22.800708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:22.915793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7608165db362445e82ab26ad984591b0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:22.937708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7608165db362445e82ab26ad984591b0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:22.939142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7608165db362445e82ab26ad984591b0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:22.939872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7608165db362445e82ab26ad984591b0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:22.956319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7608165db362445e82ab26ad984591b0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:23.004194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:23.015819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1128/2258] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:22 2022] DELETE /identity/v3/users/7608165db362445e82ab26ad984591b0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:23.020335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e372e-9241-40d8-8c9c-6f94a28a6bbd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:23.020666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e372e-9241-40d8-8c9c-6f94a28a6bbd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:23.020952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e372e-9241-40d8-8c9c-6f94a28a6bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:23.077578 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f18e372e-9241-40d8-8c9c-6f94a28a6bbd None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:23.078969 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f18e372e-9241-40d8-8c9c-6f94a28a6bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:23.223208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1131/2259] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:23.234652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:23.236588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:23.398351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fc746-e038-46c5-8a01-ba67d29d0a77 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:23.399206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fc746-e038-46c5-8a01-ba67d29d0a77 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:23.399555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fc746-e038-46c5-8a01-ba67d29d0a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:23.475952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:23.486554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6cc34-a670-4e65-ab47-39f52ed479c2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:23.487881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-144fc746-e038-46c5-8a01-ba67d29d0a77 None None] MFA Rules not processed for user `3aca35b1b0cc49f497b8ba262e574223`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:23.489205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-144fc746-e038-46c5-8a01-ba67d29d0a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:23.502801 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63535f-db47-4ea5-a4db-cbb49e49ad7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:23.506456 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63535f-db47-4ea5-a4db-cbb49e49ad7c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:23.507999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63535f-db47-4ea5-a4db-cbb49e49ad7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:23.513250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63535f-db47-4ea5-a4db-cbb49e49ad7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:23.544511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63535f-db47-4ea5-a4db-cbb49e49ad7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:23.546292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63535f-db47-4ea5-a4db-cbb49e49ad7c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:23.567315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1129/2260] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:23.770871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1132/2261] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:23.783172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf6940-bcc5-4399-8f4b-38eeb2f95aaa None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:23.783707 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf6940-bcc5-4399-8f4b-38eeb2f95aaa None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:23.783808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf6940-bcc5-4399-8f4b-38eeb2f95aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:23.808595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-77cf6940-bcc5-4399-8f4b-38eeb2f95aaa None None] MFA Rules not processed for user `fcfa895d5e4f4f0f95e1740897daf0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:23.810166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-77cf6940-bcc5-4399-8f4b-38eeb2f95aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:23.946056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1130/2262] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:23.953488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fc746-e038-46c5-8a01-ba67d29d0a77 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:23.956549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-144fc746-e038-46c5-8a01-ba67d29d0a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:24.206849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fc746-e038-46c5-8a01-ba67d29d0a77 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:24.248260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fef044-0386-4ca5-9d06-fbea51b017d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:24.255337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef044-0386-4ca5-9d06-fbea51b017d7 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:24.255730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef044-0386-4ca5-9d06-fbea51b017d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:24.256020 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fef044-0386-4ca5-9d06-fbea51b017d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:24.261754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-13fef044-0386-4ca5-9d06-fbea51b017d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:24.286076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fef044-0386-4ca5-9d06-fbea51b017d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:24.289932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fef044-0386-4ca5-9d06-fbea51b017d7 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:24.318478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1133/2263] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:24.784433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf6940-bcc5-4399-8f4b-38eeb2f95aaa None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:24.785986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-77cf6940-bcc5-4399-8f4b-38eeb2f95aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:24.808734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf6940-bcc5-4399-8f4b-38eeb2f95aaa None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:24.817342 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:24.818996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:24.819387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:24.819938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] PATH_INFO: `/v3/projects/6a136e9a7a304e9385e8a27792326685` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:24.821397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a136e9a7a304e9385e8a27792326685)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:24.823994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:24.927902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a136e9a7a304e9385e8a27792326685', 'request_id': 'req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:24.937315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a136e9a7a304e9385e8a27792326685', 'request_id': 'req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:24.957677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a136e9a7a304e9385e8a27792326685', 'request_id': 'req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:24.973875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] The token cache is being invalidate because project 6a136e9a7a304e9385e8a27792326685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:24.974247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:24.974993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c8b684fa-3271-4a3a-bf9d-b5fc610f4b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:24.976956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1131/2264] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:24 2022] DELETE /identity/v3/projects/6a136e9a7a304e9385e8a27792326685 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:24.981918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f134b0-4453-4b95-a98f-17d6562986a5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:24.982823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f134b0-4453-4b95-a98f-17d6562986a5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:24.983367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f134b0-4453-4b95-a98f-17d6562986a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:25.011462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-73f134b0-4453-4b95-a98f-17d6562986a5 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:25.013684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-73f134b0-4453-4b95-a98f-17d6562986a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:25.154243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1134/2265] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:25.162438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190c28d-726a-417a-bf31-76120011e277 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:25.163240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190c28d-726a-417a-bf31-76120011e277 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:25.163535 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190c28d-726a-417a-bf31-76120011e277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:25.234989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c190c28d-726a-417a-bf31-76120011e277 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:25.236505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c190c28d-726a-417a-bf31-76120011e277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:25.260941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1132/2266] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:25.266216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f134b0-4453-4b95-a98f-17d6562986a5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:25.280095 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f134b0-4453-4b95-a98f-17d6562986a5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:25.286804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfff19-dc1d-42df-a2d8-5fd48245d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:25.287841 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfff19-dc1d-42df-a2d8-5fd48245d0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:25.288272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfff19-dc1d-42df-a2d8-5fd48245d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:25.288759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfff19-dc1d-42df-a2d8-5fd48245d0e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:25.289696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfff19-dc1d-42df-a2d8-5fd48245d0e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:25.290153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfff19-dc1d-42df-a2d8-5fd48245d0e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:25.291917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfff19-dc1d-42df-a2d8-5fd48245d0e0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:25.312585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190c28d-726a-417a-bf31-76120011e277 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:25.312717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1135/2267] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:25.322405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190c28d-726a-417a-bf31-76120011e277 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:25.334675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5144b-886f-421b-a73b-ceb6f3cefa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:25.335319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5144b-886f-421b-a73b-ceb6f3cefa66 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:25.335596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5144b-886f-421b-a73b-ceb6f3cefa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:25.336036 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5144b-886f-421b-a73b-ceb6f3cefa66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:25.336900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5144b-886f-421b-a73b-ceb6f3cefa66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:25.339008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5144b-886f-421b-a73b-ceb6f3cefa66 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:25.383941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:25.395212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1133/2268] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:25 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:25.400018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfff19-dc1d-42df-a2d8-5fd48245d0e0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:25.415426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfff19-dc1d-42df-a2d8-5fd48245d0e0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:25.447745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:25.571328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05351b6-edd7-4f19-8218-0fc28add1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:25.572018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05351b6-edd7-4f19-8218-0fc28add1a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:25.572311 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05351b6-edd7-4f19-8218-0fc28add1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:25.572723 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05351b6-edd7-4f19-8218-0fc28add1a3a admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:25.573369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05351b6-edd7-4f19-8218-0fc28add1a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:25.592972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05351b6-edd7-4f19-8218-0fc28add1a3a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:25.658276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1136/2269] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:25 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:25.659198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5144b-886f-421b-a73b-ceb6f3cefa66 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:25.673604 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5144b-886f-421b-a73b-ceb6f3cefa66 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:25.700011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522e798-0288-4705-a355-e3b3f02dee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:25.700970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522e798-0288-4705-a355-e3b3f02dee60 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:25.701405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522e798-0288-4705-a355-e3b3f02dee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:25.701835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522e798-0288-4705-a355-e3b3f02dee60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:25.704308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522e798-0288-4705-a355-e3b3f02dee60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:25.719802 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522e798-0288-4705-a355-e3b3f02dee60 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:25.760992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1134/2270] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:25.762583 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05351b6-edd7-4f19-8218-0fc28add1a3a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:25.787538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05351b6-edd7-4f19-8218-0fc28add1a3a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:25.804597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb954c34-d066-462c-94eb-683aeaaa5cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:25.805238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb954c34-d066-462c-94eb-683aeaaa5cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:25.805562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb954c34-d066-462c-94eb-683aeaaa5cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:25.805798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb954c34-d066-462c-94eb-683aeaaa5cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:25.806469 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb954c34-d066-462c-94eb-683aeaaa5cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:25.808244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb954c34-d066-462c-94eb-683aeaaa5cb2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:25.820751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1137/2271] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:25.825117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522e798-0288-4705-a355-e3b3f02dee60 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:25.839508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522e798-0288-4705-a355-e3b3f02dee60 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:25.849516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb2867-3de5-4bfc-b2c4-97cd311b1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:25.850284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb2867-3de5-4bfc-b2c4-97cd311b1533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:25.850696 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb2867-3de5-4bfc-b2c4-97cd311b1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:25.851039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb2867-3de5-4bfc-b2c4-97cd311b1533 admin admin] PATH_INFO: `/v3/projects/14eef693ac13498faef8417fa2e48238/users/14a354aa586d44ad803850134bb9ec18/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:25.871303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb2867-3de5-4bfc-b2c4-97cd311b1533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14eef693ac13498faef8417fa2e48238, user_id=14a354aa586d44ad803850134bb9ec18, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:25.874749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb2867-3de5-4bfc-b2c4-97cd311b1533 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:25.918210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1135/2272] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:25 2022] PUT /identity/v3/projects/14eef693ac13498faef8417fa2e48238/users/14a354aa586d44ad803850134bb9ec18/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:25.923332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064116d-9098-48ca-94ae-0b354ff4cabb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:25.923620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064116d-9098-48ca-94ae-0b354ff4cabb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:25.923900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064116d-9098-48ca-94ae-0b354ff4cabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:25.956785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6064116d-9098-48ca-94ae-0b354ff4cabb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:25.957998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6064116d-9098-48ca-94ae-0b354ff4cabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:26.125494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1138/2273] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:26.191647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb2867-3de5-4bfc-b2c4-97cd311b1533 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:26.193538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4edb2867-3de5-4bfc-b2c4-97cd311b1533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:26.368516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb2867-3de5-4bfc-b2c4-97cd311b1533 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:26.375576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3909a-818b-49d3-9d6f-ca9351a80305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:26.376563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3909a-818b-49d3-9d6f-ca9351a80305 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:26.376859 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3909a-818b-49d3-9d6f-ca9351a80305 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:26.377137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3909a-818b-49d3-9d6f-ca9351a80305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:26.401768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3909a-818b-49d3-9d6f-ca9351a80305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:26.403281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3909a-818b-49d3-9d6f-ca9351a80305 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:26.438658 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1136/2274] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:28.478988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064116d-9098-48ca-94ae-0b354ff4cabb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:28.480645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6064116d-9098-48ca-94ae-0b354ff4cabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:28.498657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064116d-9098-48ca-94ae-0b354ff4cabb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:28.506887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:28.507380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:28.507663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:28.507942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] PATH_INFO: `/v3/users/596bdaef828a4d879b3e6dba63d5b68c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:28.509182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=596bdaef828a4d879b3e6dba63d5b68c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:28.511374 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:28.568240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596bdaef828a4d879b3e6dba63d5b68c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:28.568930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596bdaef828a4d879b3e6dba63d5b68c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:28.582817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596bdaef828a4d879b3e6dba63d5b68c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:28.606594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596bdaef828a4d879b3e6dba63d5b68c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:28.607379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596bdaef828a4d879b3e6dba63d5b68c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:28.632706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1139/2275] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:28 2022] DELETE /identity/v3/users/596bdaef828a4d879b3e6dba63d5b68c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:28.637331 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642ac54-4c7f-4aa6-af09-ad0ba25583fe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:28.637830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642ac54-4c7f-4aa6-af09-ad0ba25583fe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:28.638027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642ac54-4c7f-4aa6-af09-ad0ba25583fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:28.662543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a642ac54-4c7f-4aa6-af09-ad0ba25583fe None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:28.664019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a642ac54-4c7f-4aa6-af09-ad0ba25583fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:28.774648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1137/2276] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:28.790172 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:28.792355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:28.801247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:28.868468 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3e4a2-b562-47cc-ac2c-923370765f09 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:28.873043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2e37-4a7c-42d7-be2a-2e64c07d8049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:28.873806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2e37-4a7c-42d7-be2a-2e64c07d8049 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:28.874398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2e37-4a7c-42d7-be2a-2e64c07d8049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:28.874749 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2e37-4a7c-42d7-be2a-2e64c07d8049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:28.890826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2e37-4a7c-42d7-be2a-2e64c07d8049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:28.893308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2e37-4a7c-42d7-be2a-2e64c07d8049 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:28.911343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1140/2277] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:29.644677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642ac54-4c7f-4aa6-af09-ad0ba25583fe None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:29.646748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a642ac54-4c7f-4aa6-af09-ad0ba25583fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:29.665745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642ac54-4c7f-4aa6-af09-ad0ba25583fe None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:29.671201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:29.673236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:29.673514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:29.673956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] PATH_INFO: `/v3/projects/76d21befa9f54fae807f97766de7db72` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:29.676075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d21befa9f54fae807f97766de7db72)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:29.678224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:29.747960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d21befa9f54fae807f97766de7db72', 'request_id': 'req-346635c6-4cf9-4d5e-854f-3996f2332224'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:29.755735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d21befa9f54fae807f97766de7db72', 'request_id': 'req-346635c6-4cf9-4d5e-854f-3996f2332224'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:29.770204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d21befa9f54fae807f97766de7db72', 'request_id': 'req-346635c6-4cf9-4d5e-854f-3996f2332224'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:29.774923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:29.792046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] The token cache is being invalidate because project 76d21befa9f54fae807f97766de7db72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:29.792737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:29.794177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:29.796552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1138/2278] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:29 2022] DELETE /identity/v3/projects/76d21befa9f54fae807f97766de7db72 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:29.799946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2e37-4a7c-42d7-be2a-2e64c07d8049 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:29.811923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2e37-4a7c-42d7-be2a-2e64c07d8049 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:29.893371 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:29.894122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:29.894410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:29.894736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] PATH_INFO: `/v3/users/accdd174c118492796ab2ccaf51c15d1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:29.896423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=accdd174c118492796ab2ccaf51c15d1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:29.898499 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:29.970011 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accdd174c118492796ab2ccaf51c15d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:29.987461 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accdd174c118492796ab2ccaf51c15d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.032383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accdd174c118492796ab2ccaf51c15d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.052048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accdd174c118492796ab2ccaf51c15d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.055381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-43a292a4-63aa-4bb2-85c9-0cfe3a8e3dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accdd174c118492796ab2ccaf51c15d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.086166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1141/2279] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:29 2022] DELETE /identity/v3/users/accdd174c118492796ab2ccaf51c15d1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:30.196939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:30.198522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:30.225289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346635c6-4cf9-4d5e-854f-3996f2332224 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:30.308210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:30.308981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:30.310280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:30.310280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] PATH_INFO: `/v3/users/e47911fcfd884ef993fd30fb6549f586` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:30.310865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47911fcfd884ef993fd30fb6549f586)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:30.313433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:30.383320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47911fcfd884ef993fd30fb6549f586'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.395179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47911fcfd884ef993fd30fb6549f586'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.400580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47911fcfd884ef993fd30fb6549f586'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.405787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47911fcfd884ef993fd30fb6549f586'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.430680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47911fcfd884ef993fd30fb6549f586'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.457925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1139/2280] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:30 2022] DELETE /identity/v3/users/e47911fcfd884ef993fd30fb6549f586 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:30.466380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eda1b-1430-44e5-9e63-0f7e4bbb5ff2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:30.471286 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eda1b-1430-44e5-9e63-0f7e4bbb5ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:30.473566 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945eda1b-1430-44e5-9e63-0f7e4bbb5ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:30.535486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-945eda1b-1430-44e5-9e63-0f7e4bbb5ff2 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:30.536912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-945eda1b-1430-44e5-9e63-0f7e4bbb5ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:30.558431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:30.577754 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:30.579431 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:30.619005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1142/2281] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:30.628734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945eda1b-1430-44e5-9e63-0f7e4bbb5ff2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:30.630393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-945eda1b-1430-44e5-9e63-0f7e4bbb5ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:30.706048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945eda1b-1430-44e5-9e63-0f7e4bbb5ff2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:30.721389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd4888-6bec-4614-9d66-c6fe90217bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:30.722055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd4888-6bec-4614-9d66-c6fe90217bab service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:30.722347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd4888-6bec-4614-9d66-c6fe90217bab service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:30.722633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd4888-6bec-4614-9d66-c6fe90217bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:30.727525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136583ef-7e13-4551-9bc1-b604135e8457 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:30.735978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:30.737153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:30.737646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:30.738156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] PATH_INFO: `/v3/projects/1b079cb9057b4a1087937889a5da343b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:30.739586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b079cb9057b4a1087937889a5da343b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:30.741957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:30.751183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd4888-6bec-4614-9d66-c6fe90217bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:30.753215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd4888-6bec-4614-9d66-c6fe90217bab service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:30.758537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:30.775862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1143/2282] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:30.821985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b079cb9057b4a1087937889a5da343b', 'request_id': 'req-9ea9bdab-4af3-4fc3-8210-24cbe3298683'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.831674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b079cb9057b4a1087937889a5da343b', 'request_id': 'req-9ea9bdab-4af3-4fc3-8210-24cbe3298683'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.845133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b079cb9057b4a1087937889a5da343b', 'request_id': 'req-9ea9bdab-4af3-4fc3-8210-24cbe3298683'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.864164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] The token cache is being invalidate because project 1b079cb9057b4a1087937889a5da343b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:30.864656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.865627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9ea9bdab-4af3-4fc3-8210-24cbe3298683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:30.867479 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1140/2283] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:30 2022] DELETE /identity/v3/projects/1b079cb9057b4a1087937889a5da343b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:30.873675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d033a2-71cf-4b48-8a4b-0374e7d88157 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:30.874261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d033a2-71cf-4b48-8a4b-0374e7d88157 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:30.875182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d033a2-71cf-4b48-8a4b-0374e7d88157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:30.907632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-16d033a2-71cf-4b48-8a4b-0374e7d88157 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:30.911004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-16d033a2-71cf-4b48-8a4b-0374e7d88157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:31.063105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1144/2284] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:31.072212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f77f1-878e-4448-a8aa-c50cd7c8e201 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.072645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f77f1-878e-4448-a8aa-c50cd7c8e201 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.072932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f77f1-878e-4448-a8aa-c50cd7c8e201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.097234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-373f77f1-878e-4448-a8aa-c50cd7c8e201 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:31.098146 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-373f77f1-878e-4448-a8aa-c50cd7c8e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:31.111988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d033a2-71cf-4b48-8a4b-0374e7d88157 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:31.119409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1141/2285] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:31.126182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d033a2-71cf-4b48-8a4b-0374e7d88157 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:31.145902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256c0ce-f552-4cb7-b194-b29cad5c225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:31.146703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256c0ce-f552-4cb7-b194-b29cad5c225a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.146990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256c0ce-f552-4cb7-b194-b29cad5c225a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.150074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256c0ce-f552-4cb7-b194-b29cad5c225a admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.150826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256c0ce-f552-4cb7-b194-b29cad5c225a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:31.153701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256c0ce-f552-4cb7-b194-b29cad5c225a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:31.155448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256c0ce-f552-4cb7-b194-b29cad5c225a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:31.186828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f77f1-878e-4448-a8aa-c50cd7c8e201 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:31.198425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1145/2286] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 17:05:31.199081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f77f1-878e-4448-a8aa-c50cd7c8e201 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:31.204131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed893f4-1cf2-4200-b096-7f53b1ee1132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:31.204911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed893f4-1cf2-4200-b096-7f53b1ee1132 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.205265 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed893f4-1cf2-4200-b096-7f53b1ee1132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.205548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed893f4-1cf2-4200-b096-7f53b1ee1132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.206494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed893f4-1cf2-4200-b096-7f53b1ee1132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:31.212511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed893f4-1cf2-4200-b096-7f53b1ee1132 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:31.269468 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1142/2287] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:31 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:31.274883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256c0ce-f552-4cb7-b194-b29cad5c225a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:31.286728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256c0ce-f552-4cb7-b194-b29cad5c225a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:31.424317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:31.448675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed893f4-1cf2-4200-b096-7f53b1ee1132 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:31.455530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-eed893f4-1cf2-4200-b096-7f53b1ee1132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:31.472448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed691e3-2723-4487-9d56-167d10f1de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:31.475612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed691e3-2723-4487-9d56-167d10f1de28 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.475899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed691e3-2723-4487-9d56-167d10f1de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.476220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed691e3-2723-4487-9d56-167d10f1de28 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.478303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed691e3-2723-4487-9d56-167d10f1de28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:31.491021 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed691e3-2723-4487-9d56-167d10f1de28 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:31.508907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed893f4-1cf2-4200-b096-7f53b1ee1132 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:31.522698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:31.523283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.523562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.523835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] PATH_INFO: `/v3/projects/71746a71b63646c0b1cee9c5bd6f2c06` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.545316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=71746a71b63646c0b1cee9c5bd6f2c06)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:31.548372 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1146/2288] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:31 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:31.553081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed691e3-2723-4487-9d56-167d10f1de28 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:31.554590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:31.572119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed691e3-2723-4487-9d56-167d10f1de28 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:31.588380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80846cdd-2d4d-4df0-ba9d-62213a8bd2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:31.589224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80846cdd-2d4d-4df0-ba9d-62213a8bd2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.591284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80846cdd-2d4d-4df0-ba9d-62213a8bd2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.591284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80846cdd-2d4d-4df0-ba9d-62213a8bd2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.591284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80846cdd-2d4d-4df0-ba9d-62213a8bd2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:31.597585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80846cdd-2d4d-4df0-ba9d-62213a8bd2f2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:31.619668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1147/2289] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:05:31.623850 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80846cdd-2d4d-4df0-ba9d-62213a8bd2f2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:31.645554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80846cdd-2d4d-4df0-ba9d-62213a8bd2f2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:31.657171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c095dc-618f-4fa0-b8bc-52f5e423c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:31.657819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c095dc-618f-4fa0-b8bc-52f5e423c67a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.658178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c095dc-618f-4fa0-b8bc-52f5e423c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.658388 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c095dc-618f-4fa0-b8bc-52f5e423c67a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.659198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c095dc-618f-4fa0-b8bc-52f5e423c67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:31.663751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c095dc-618f-4fa0-b8bc-52f5e423c67a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:31.687479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1148/2290] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:31.693519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c095dc-618f-4fa0-b8bc-52f5e423c67a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:31.716606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c095dc-618f-4fa0-b8bc-52f5e423c67a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:31.756370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71746a71b63646c0b1cee9c5bd6f2c06', 'request_id': 'req-d5839d51-493a-4fa6-83ee-aeec848598cf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:31.773279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71746a71b63646c0b1cee9c5bd6f2c06', 'request_id': 'req-d5839d51-493a-4fa6-83ee-aeec848598cf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:31.794828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71746a71b63646c0b1cee9c5bd6f2c06', 'request_id': 'req-d5839d51-493a-4fa6-83ee-aeec848598cf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:31.819935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] The token cache is being invalidate because project 71746a71b63646c0b1cee9c5bd6f2c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:31.820253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:31.822092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d5839d51-493a-4fa6-83ee-aeec848598cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:31.831863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1143/2291] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:31 2022] DELETE /identity/v3/projects/71746a71b63646c0b1cee9c5bd6f2c06 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:31.833766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db5f0-975b-492b-8a34-fe7754383140 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.834039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db5f0-975b-492b-8a34-fe7754383140 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.834396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db5f0-975b-492b-8a34-fe7754383140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.839205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25f037-2fcc-4022-85b2-88a130de5f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:31.840921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25f037-2fcc-4022-85b2-88a130de5f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.841486 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25f037-2fcc-4022-85b2-88a130de5f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.842978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25f037-2fcc-4022-85b2-88a130de5f03 admin admin] PATH_INFO: `/v3/projects/a9710b8bb82745cbb0bb0dd172a10b0f/users/ab2f60660c3e453d8003f7bfddf89ae9/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.864341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-524db5f0-975b-492b-8a34-fe7754383140 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:31.867598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-524db5f0-975b-492b-8a34-fe7754383140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:31.885699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1144/2292] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:31.886560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25f037-2fcc-4022-85b2-88a130de5f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9710b8bb82745cbb0bb0dd172a10b0f, user_id=ab2f60660c3e453d8003f7bfddf89ae9, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:31.888572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1b699-1674-4143-ad66-d763146f999f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.888855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1b699-1674-4143-ad66-d763146f999f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.889134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1b699-1674-4143-ad66-d763146f999f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.890057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25f037-2fcc-4022-85b2-88a130de5f03 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:31.918941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f2d1b699-1674-4143-ad66-d763146f999f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:31.920257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f2d1b699-1674-4143-ad66-d763146f999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:31.922877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1149/2293] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:31 2022] PUT /identity/v3/projects/a9710b8bb82745cbb0bb0dd172a10b0f/users/ab2f60660c3e453d8003f7bfddf89ae9/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:05:31.934951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33af5-7d53-4db0-993c-0d91b4ec832f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:31.935292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33af5-7d53-4db0-993c-0d91b4ec832f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:31.935834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f33af5-7d53-4db0-993c-0d91b4ec832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:31.972220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b4f33af5-7d53-4db0-993c-0d91b4ec832f None None] MFA Rules not processed for user `ab2f60660c3e453d8003f7bfddf89ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:31.974101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b4f33af5-7d53-4db0-993c-0d91b4ec832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:32.013926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:32.060622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1145/2294] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:05:32.061849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1b699-1674-4143-ad66-d763146f999f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.078454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1b699-1674-4143-ad66-d763146f999f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.085973 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f3fc7-d118-4974-b505-e802aeac64a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.086689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f3fc7-d118-4974-b505-e802aeac64a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.087500 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f3fc7-d118-4974-b505-e802aeac64a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.087500 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f3fc7-d118-4974-b505-e802aeac64a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.088031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f3fc7-d118-4974-b505-e802aeac64a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:32.088534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f3fc7-d118-4974-b505-e802aeac64a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.092266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f3fc7-d118-4974-b505-e802aeac64a6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.098808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1150/2295] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:32.104538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f33af5-7d53-4db0-993c-0d91b4ec832f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.108477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b4f33af5-7d53-4db0-993c-0d91b4ec832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:32.109461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1146/2296] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:05:32.114240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f3fc7-d118-4974-b505-e802aeac64a6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.126548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f3fc7-d118-4974-b505-e802aeac64a6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.129784 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f33af5-7d53-4db0-993c-0d91b4ec832f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.131807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eac828-3301-43dc-8d21-71407c2de08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.132474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eac828-3301-43dc-8d21-71407c2de08e admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.133447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eac828-3301-43dc-8d21-71407c2de08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.133748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eac828-3301-43dc-8d21-71407c2de08e admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.134388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eac828-3301-43dc-8d21-71407c2de08e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.136600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eac828-3301-43dc-8d21-71407c2de08e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.138607 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93bd1c-22fd-4fac-8835-026c75d69967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.139470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93bd1c-22fd-4fac-8835-026c75d69967 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.139935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93bd1c-22fd-4fac-8835-026c75d69967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.140668 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93bd1c-22fd-4fac-8835-026c75d69967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.141543 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93bd1c-22fd-4fac-8835-026c75d69967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.147047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93bd1c-22fd-4fac-8835-026c75d69967 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.181084 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1147/2297] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:32 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:32.182093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eac828-3301-43dc-8d21-71407c2de08e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.208923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1151/2298] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:32 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:32.214604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93bd1c-22fd-4fac-8835-026c75d69967 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.269920 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:32.272571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eac828-3301-43dc-8d21-71407c2de08e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.355573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ae9a1-a4b3-4c89-be68-c064008c4589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.356740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae9a1-a4b3-4c89-be68-c064008c4589 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.357328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae9a1-a4b3-4c89-be68-c064008c4589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.357799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ae9a1-a4b3-4c89-be68-c064008c4589 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.359998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ae9a1-a4b3-4c89-be68-c064008c4589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.362506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ae9a1-a4b3-4c89-be68-c064008c4589 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.408038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1148/2299] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:32 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:32.414944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ae9a1-a4b3-4c89-be68-c064008c4589 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.423073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93bd1c-22fd-4fac-8835-026c75d69967 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.435253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a06fb-c652-498d-ad55-8f4afef8953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.437121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a06fb-c652-498d-ad55-8f4afef8953e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.439505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ae9a1-a4b3-4c89-be68-c064008c4589 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.440446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a06fb-c652-498d-ad55-8f4afef8953e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.440804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a06fb-c652-498d-ad55-8f4afef8953e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.441487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a06fb-c652-498d-ad55-8f4afef8953e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.447881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a06fb-c652-498d-ad55-8f4afef8953e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.460950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac3de0-7abb-4743-9e47-518af7813ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.461597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3de0-7abb-4743-9e47-518af7813ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.461874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3de0-7abb-4743-9e47-518af7813ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.462258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3de0-7abb-4743-9e47-518af7813ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.462964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac3de0-7abb-4743-9e47-518af7813ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.464824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac3de0-7abb-4743-9e47-518af7813ad6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.497266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1149/2300] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:32.498271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac3de0-7abb-4743-9e47-518af7813ad6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.501989 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1152/2301] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:32 2022] POST /identity/v3/users => generated 298 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:32.503182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a06fb-c652-498d-ad55-8f4afef8953e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.519837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac3de0-7abb-4743-9e47-518af7813ad6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.524509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a06fb-c652-498d-ad55-8f4afef8953e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.533685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7863da-626e-4c82-a029-159013a2e707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.534325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7863da-626e-4c82-a029-159013a2e707 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.534617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7863da-626e-4c82-a029-159013a2e707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.534880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7863da-626e-4c82-a029-159013a2e707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.535972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7863da-626e-4c82-a029-159013a2e707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.537202 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7863da-626e-4c82-a029-159013a2e707 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.538399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dd2f0-3659-48bc-8ef3-878ce76219ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.538977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dd2f0-3659-48bc-8ef3-878ce76219ae admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.539263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dd2f0-3659-48bc-8ef3-878ce76219ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.539523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dd2f0-3659-48bc-8ef3-878ce76219ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.540183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dd2f0-3659-48bc-8ef3-878ce76219ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.541848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dd2f0-3659-48bc-8ef3-878ce76219ae admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.575821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1153/2302] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:32.577502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1150/2303] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:32.578746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dd2f0-3659-48bc-8ef3-878ce76219ae admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.579305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7863da-626e-4c82-a029-159013a2e707 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.597135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7863da-626e-4c82-a029-159013a2e707 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.604249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef2317-37ae-4119-9683-af2b824fbe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.605448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef2317-37ae-4119-9683-af2b824fbe04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.605793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef2317-37ae-4119-9683-af2b824fbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.606074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef2317-37ae-4119-9683-af2b824fbe04 admin admin] PATH_INFO: `/v3/projects/3467cf11a40a4a5bac246c3f5cade2be/users/d7248d37148741a488676b76a0434c1a/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.607935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dd2f0-3659-48bc-8ef3-878ce76219ae admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.619574 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c499d3-f9fc-4352-ac78-146f96c6f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.620619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c499d3-f9fc-4352-ac78-146f96c6f2af admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.622355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c499d3-f9fc-4352-ac78-146f96c6f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.622946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c499d3-f9fc-4352-ac78-146f96c6f2af admin admin] PATH_INFO: `/v3/projects/b7f47f3ea33a4f9abb269f56051f546c/users/36aaeaec47f64554b90c0963b8b71d7a/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.637707 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef2317-37ae-4119-9683-af2b824fbe04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3467cf11a40a4a5bac246c3f5cade2be, user_id=d7248d37148741a488676b76a0434c1a, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.640956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef2317-37ae-4119-9683-af2b824fbe04 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.664318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1151/2304] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:32 2022] PUT /identity/v3/projects/3467cf11a40a4a5bac246c3f5cade2be/users/d7248d37148741a488676b76a0434c1a/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:32.664640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c499d3-f9fc-4352-ac78-146f96c6f2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f47f3ea33a4f9abb269f56051f546c, user_id=36aaeaec47f64554b90c0963b8b71d7a, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.667707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c499d3-f9fc-4352-ac78-146f96c6f2af admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.676682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e7bd-0cb1-4cfd-a2d0-549f65f77927 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.677104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e7bd-0cb1-4cfd-a2d0-549f65f77927 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.677502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e7bd-0cb1-4cfd-a2d0-549f65f77927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.690108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:32.699418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1154/2305] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:32 2022] PUT /identity/v3/projects/b7f47f3ea33a4f9abb269f56051f546c/users/36aaeaec47f64554b90c0963b8b71d7a/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:32.713387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c499d3-f9fc-4352-ac78-146f96c6f2af admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.748212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bc47e7bd-0cb1-4cfd-a2d0-549f65f77927 None None] MFA Rules not processed for user `d7248d37148741a488676b76a0434c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:32.749758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bc47e7bd-0cb1-4cfd-a2d0-549f65f77927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:32.852656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1152/2306] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:32.860964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47e7bd-0cb1-4cfd-a2d0-549f65f77927 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.863242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bc47e7bd-0cb1-4cfd-a2d0-549f65f77927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:32.904727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c499d3-f9fc-4352-ac78-146f96c6f2af admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.910001 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739c6aa-6670-4e42-aa18-196eb1e3124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.910704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739c6aa-6670-4e42-aa18-196eb1e3124f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.911075 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739c6aa-6670-4e42-aa18-196eb1e3124f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.911420 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739c6aa-6670-4e42-aa18-196eb1e3124f admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.912140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739c6aa-6670-4e42-aa18-196eb1e3124f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.913873 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739c6aa-6670-4e42-aa18-196eb1e3124f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.925619 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1155/2307] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:32.934328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739c6aa-6670-4e42-aa18-196eb1e3124f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:32.948761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739c6aa-6670-4e42-aa18-196eb1e3124f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:32.954340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a08b-82af-45ff-a6ec-a0eabe96a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:32.955278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a08b-82af-45ff-a6ec-a0eabe96a411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.955635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a08b-82af-45ff-a6ec-a0eabe96a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.957459 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a08b-82af-45ff-a6ec-a0eabe96a411 admin admin] PATH_INFO: `/v3/projects/b7f47f3ea33a4f9abb269f56051f546c/users/36aaeaec47f64554b90c0963b8b71d7a/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:32.958634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136a08b-82af-45ff-a6ec-a0eabe96a411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f47f3ea33a4f9abb269f56051f546c, user_id=36aaeaec47f64554b90c0963b8b71d7a, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:32.962086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136a08b-82af-45ff-a6ec-a0eabe96a411 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:32.984643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1156/2308] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:32 2022] PUT /identity/v3/projects/b7f47f3ea33a4f9abb269f56051f546c/users/36aaeaec47f64554b90c0963b8b71d7a/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:32.998990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f718-3ea9-4c11-a1f8-f4d7f6e77ff7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:32.999280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f718-3ea9-4c11-a1f8-f4d7f6e77ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:32.999554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f718-3ea9-4c11-a1f8-f4d7f6e77ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:33.049274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47e7bd-0cb1-4cfd-a2d0-549f65f77927 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:33.069439 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9252f718-3ea9-4c11-a1f8-f4d7f6e77ff7 None None] MFA Rules not processed for user `36aaeaec47f64554b90c0963b8b71d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:33.071429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9252f718-3ea9-4c11-a1f8-f4d7f6e77ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:33.185342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:33.212151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cc869-5262-4467-8729-2e24a5846dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:33.213265 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc869-5262-4467-8729-2e24a5846dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:33.213553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc869-5262-4467-8729-2e24a5846dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:33.213951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc869-5262-4467-8729-2e24a5846dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:33.249214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1157/2309] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:33.267169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252f718-3ea9-4c11-a1f8-f4d7f6e77ff7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:33.268973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9252f718-3ea9-4c11-a1f8-f4d7f6e77ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:33.294179 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252f718-3ea9-4c11-a1f8-f4d7f6e77ff7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:33.306158 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26603a4-591d-4b2a-bebf-5562c7fd70be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:33.306714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26603a4-591d-4b2a-bebf-5562c7fd70be service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:33.306992 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26603a4-591d-4b2a-bebf-5562c7fd70be service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:33.307269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26603a4-591d-4b2a-bebf-5562c7fd70be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:33.328282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26603a4-591d-4b2a-bebf-5562c7fd70be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:33.329155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26603a4-591d-4b2a-bebf-5562c7fd70be service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:33.362626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1158/2310] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:05:33.379035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cc869-5262-4467-8729-2e24a5846dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:33.382843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cc869-5262-4467-8729-2e24a5846dc3 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:33.415516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1153/2311] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:33.702591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a6154-dc36-450e-bd84-648dd90ca401 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:33.702856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a6154-dc36-450e-bd84-648dd90ca401 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:33.703143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a6154-dc36-450e-bd84-648dd90ca401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:33.744690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1e7a6154-dc36-450e-bd84-648dd90ca401 None None] MFA Rules not processed for user `14a354aa586d44ad803850134bb9ec18`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:33.748089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1e7a6154-dc36-450e-bd84-648dd90ca401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:33.888845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1159/2312] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:33.890581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cc869-5262-4467-8729-2e24a5846dc3 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:33.891794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d70cc869-5262-4467-8729-2e24a5846dc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:33.901094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:34.151553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cc869-5262-4467-8729-2e24a5846dc3 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:34.178260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29352f38-2200-46cc-aa7d-ed703dd1c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:34.182096 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29352f38-2200-46cc-aa7d-ed703dd1c1bf admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:34.183711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29352f38-2200-46cc-aa7d-ed703dd1c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:34.184202 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29352f38-2200-46cc-aa7d-ed703dd1c1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:34.187774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29352f38-2200-46cc-aa7d-ed703dd1c1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:34.197695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29352f38-2200-46cc-aa7d-ed703dd1c1bf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:34.309763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1154/2313] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:33 2022] POST /identity/v3/projects => generated 383 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:34.313238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a6154-dc36-450e-bd84-648dd90ca401 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:34.337346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a6154-dc36-450e-bd84-648dd90ca401 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:34.506595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ea13b-c4df-4f47-a678-1b8a01a77420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:34.506825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ea13b-c4df-4f47-a678-1b8a01a77420 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:34.507070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ea13b-c4df-4f47-a678-1b8a01a77420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:34.507393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ea13b-c4df-4f47-a678-1b8a01a77420 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:34.508340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ea13b-c4df-4f47-a678-1b8a01a77420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:34.510779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ea13b-c4df-4f47-a678-1b8a01a77420 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:34.583386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1160/2314] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:34 2022] POST /identity/v3/users => generated 298 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:34.591397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29352f38-2200-46cc-aa7d-ed703dd1c1bf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:34.623541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29352f38-2200-46cc-aa7d-ed703dd1c1bf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:34.640610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be194-0215-43f7-ad0a-94909576f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:34.641578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be194-0215-43f7-ad0a-94909576f9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:34.641944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be194-0215-43f7-ad0a-94909576f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:34.642664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be194-0215-43f7-ad0a-94909576f9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:34.643675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5be194-0215-43f7-ad0a-94909576f9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:34.645442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5be194-0215-43f7-ad0a-94909576f9e9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:34.675160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1155/2315] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:34.680135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ea13b-c4df-4f47-a678-1b8a01a77420 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:34.694837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ea13b-c4df-4f47-a678-1b8a01a77420 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:34.703011 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f4d7d-cb0a-4ce5-ab40-c7776c569ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:34.704143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f4d7d-cb0a-4ce5-ab40-c7776c569ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:34.704641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f4d7d-cb0a-4ce5-ab40-c7776c569ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:34.705001 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f4d7d-cb0a-4ce5-ab40-c7776c569ae2 admin admin] PATH_INFO: `/v3/projects/1e378d2f57f64840982c8fc5c6e0ef9f/users/381b30cab19b41608e675bc7ebf2da61/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:34.726642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f4d7d-cb0a-4ce5-ab40-c7776c569ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e378d2f57f64840982c8fc5c6e0ef9f, user_id=381b30cab19b41608e675bc7ebf2da61, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:34.730397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f4d7d-cb0a-4ce5-ab40-c7776c569ae2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:34.764565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1161/2316] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:34 2022] PUT /identity/v3/projects/1e378d2f57f64840982c8fc5c6e0ef9f/users/381b30cab19b41608e675bc7ebf2da61/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:34.766641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be194-0215-43f7-ad0a-94909576f9e9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:34.780137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be194-0215-43f7-ad0a-94909576f9e9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:34.857504 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d42ab-5fbd-4d0a-a70d-76860eb29940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:34.858216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d42ab-5fbd-4d0a-a70d-76860eb29940 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:34.858501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d42ab-5fbd-4d0a-a70d-76860eb29940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:34.858773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d42ab-5fbd-4d0a-a70d-76860eb29940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:34.859447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d42ab-5fbd-4d0a-a70d-76860eb29940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:34.861263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d42ab-5fbd-4d0a-a70d-76860eb29940 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:34.874343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1156/2317] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:34.878688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f4d7d-cb0a-4ce5-ab40-c7776c569ae2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:34.890249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f4d7d-cb0a-4ce5-ab40-c7776c569ae2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:34.895927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0e866-7b0c-480b-9deb-630ac0f145af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:34.896707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0e866-7b0c-480b-9deb-630ac0f145af admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:34.896986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0e866-7b0c-480b-9deb-630ac0f145af admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:34.897261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0e866-7b0c-480b-9deb-630ac0f145af admin admin] PATH_INFO: `/v3/projects/1e378d2f57f64840982c8fc5c6e0ef9f/users/381b30cab19b41608e675bc7ebf2da61/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:34.899184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0e866-7b0c-480b-9deb-630ac0f145af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e378d2f57f64840982c8fc5c6e0ef9f, user_id=381b30cab19b41608e675bc7ebf2da61, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:34.901971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0e866-7b0c-480b-9deb-630ac0f145af admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:34.913012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1162/2318] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:34 2022] PUT /identity/v3/projects/1e378d2f57f64840982c8fc5c6e0ef9f/users/381b30cab19b41608e675bc7ebf2da61/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:34.932553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d42ab-5fbd-4d0a-a70d-76860eb29940 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:34.944214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d42ab-5fbd-4d0a-a70d-76860eb29940 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:35.008490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:35.009141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:35.009429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:35.009828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] PATH_INFO: `/v3/users/ab2f60660c3e453d8003f7bfddf89ae9` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:35.011036 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2f60660c3e453d8003f7bfddf89ae9)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:35.013264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:35.030874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:35.090889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2f60660c3e453d8003f7bfddf89ae9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:35.101290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2f60660c3e453d8003f7bfddf89ae9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:35.102492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2f60660c3e453d8003f7bfddf89ae9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:35.103316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2f60660c3e453d8003f7bfddf89ae9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:35.136195 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2f60660c3e453d8003f7bfddf89ae9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:35.158132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1157/2319] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:34 2022] DELETE /identity/v3/users/ab2f60660c3e453d8003f7bfddf89ae9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:35.162557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a0aa-d57f-483d-826f-f95f56a46cd0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:35.163007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a0aa-d57f-483d-826f-f95f56a46cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:35.163450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a0aa-d57f-483d-826f-f95f56a46cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:35.188183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:35.205293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-06b6a0aa-d57f-483d-826f-f95f56a46cd0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:35.207261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-06b6a0aa-d57f-483d-826f-f95f56a46cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:35.288986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1163/2320] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:35.321149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:35.323303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:35.485819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f32420-dbed-48d6-bd63-dd238315ff3f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:35.496706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d014a7-6fe0-4d32-b3d3-d50dddfdd0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:35.497581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d014a7-6fe0-4d32-b3d3-d50dddfdd0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:35.497858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d014a7-6fe0-4d32-b3d3-d50dddfdd0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:35.498134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d014a7-6fe0-4d32-b3d3-d50dddfdd0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:35.533957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d014a7-6fe0-4d32-b3d3-d50dddfdd0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:35.536060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d014a7-6fe0-4d32-b3d3-d50dddfdd0b4 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:35.560909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1158/2321] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:36.361067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6a0aa-d57f-483d-826f-f95f56a46cd0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:36.362747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-06b6a0aa-d57f-483d-826f-f95f56a46cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:36.386450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6a0aa-d57f-483d-826f-f95f56a46cd0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:36.399685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:36.400630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:36.401107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:36.402057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] PATH_INFO: `/v3/projects/a9710b8bb82745cbb0bb0dd172a10b0f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:36.405034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9710b8bb82745cbb0bb0dd172a10b0f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:36.408002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:36.495853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9710b8bb82745cbb0bb0dd172a10b0f', 'request_id': 'req-2d799fdc-3f8b-449f-bd3f-78e9935b593b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:36.508874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9710b8bb82745cbb0bb0dd172a10b0f', 'request_id': 'req-2d799fdc-3f8b-449f-bd3f-78e9935b593b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:36.518446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9710b8bb82745cbb0bb0dd172a10b0f', 'request_id': 'req-2d799fdc-3f8b-449f-bd3f-78e9935b593b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:36.534863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] The token cache is being invalidate because project a9710b8bb82745cbb0bb0dd172a10b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:36.535418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:36.536393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:36.542556 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1164/2322] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:36 2022] DELETE /identity/v3/projects/a9710b8bb82745cbb0bb0dd172a10b0f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:36.544364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d014a7-6fe0-4d32-b3d3-d50dddfdd0b4 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:36.555113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d014a7-6fe0-4d32-b3d3-d50dddfdd0b4 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:36.648600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:36.649545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:36.649974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:36.650538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] PATH_INFO: `/v3/users/36aaeaec47f64554b90c0963b8b71d7a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:36.652743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36aaeaec47f64554b90c0963b8b71d7a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:36.657327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:36.760099 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:36.774720 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36aaeaec47f64554b90c0963b8b71d7a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:36.790554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36aaeaec47f64554b90c0963b8b71d7a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:36.791468 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36aaeaec47f64554b90c0963b8b71d7a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:36.792035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36aaeaec47f64554b90c0963b8b71d7a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:36.808418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-60a6e743-5145-4587-a164-e2a853c0f709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36aaeaec47f64554b90c0963b8b71d7a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:36.840091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1159/2323] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:36 2022] DELETE /identity/v3/users/36aaeaec47f64554b90c0963b8b71d7a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:37.713995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:37.717838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:37.758483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d799fdc-3f8b-449f-bd3f-78e9935b593b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:37.849798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:37.850720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:37.851047 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:37.851632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] PATH_INFO: `/v3/projects/b7f47f3ea33a4f9abb269f56051f546c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:37.853591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f47f3ea33a4f9abb269f56051f546c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:37.857007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:37.903125 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:37.921715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f47f3ea33a4f9abb269f56051f546c', 'request_id': 'req-9afa4643-5c20-4862-b654-436cd1fb07d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:37.935382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f47f3ea33a4f9abb269f56051f546c', 'request_id': 'req-9afa4643-5c20-4862-b654-436cd1fb07d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:37.943803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f47f3ea33a4f9abb269f56051f546c', 'request_id': 'req-9afa4643-5c20-4862-b654-436cd1fb07d0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:37.956756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] The token cache is being invalidate because project b7f47f3ea33a4f9abb269f56051f546c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:37.957028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:37.957974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9afa4643-5c20-4862-b654-436cd1fb07d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:37.959878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1165/2324] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:37 2022] DELETE /identity/v3/projects/b7f47f3ea33a4f9abb269f56051f546c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:37.966010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc0100-ec38-4d3c-bb65-dcdae8eb7da3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:37.966950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc0100-ec38-4d3c-bb65-dcdae8eb7da3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:37.967489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc0100-ec38-4d3c-bb65-dcdae8eb7da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:37.988569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c2fc0100-ec38-4d3c-bb65-dcdae8eb7da3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:37.990206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c2fc0100-ec38-4d3c-bb65-dcdae8eb7da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:38.079797 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1160/2325] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:38.088643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134024bf-3cb9-4061-8f24-fe051899a64e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:38.088930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134024bf-3cb9-4061-8f24-fe051899a64e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:38.089202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134024bf-3cb9-4061-8f24-fe051899a64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:38.112877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-134024bf-3cb9-4061-8f24-fe051899a64e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:38.114675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-134024bf-3cb9-4061-8f24-fe051899a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:38.129144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1166/2326] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:38.129640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc0100-ec38-4d3c-bb65-dcdae8eb7da3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:38.146561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc0100-ec38-4d3c-bb65-dcdae8eb7da3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:38.162833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e763e-3cb6-45f7-83d0-02259fce1a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:38.163718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e763e-3cb6-45f7-83d0-02259fce1a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:38.164199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e763e-3cb6-45f7-83d0-02259fce1a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:38.164686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e763e-3cb6-45f7-83d0-02259fce1a82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:38.165621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e763e-3cb6-45f7-83d0-02259fce1a82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:05:38.166258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e763e-3cb6-45f7-83d0-02259fce1a82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:38.168131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e763e-3cb6-45f7-83d0-02259fce1a82 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:38.191506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1161/2327] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 17:05:38.195658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134024bf-3cb9-4061-8f24-fe051899a64e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:38.211573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134024bf-3cb9-4061-8f24-fe051899a64e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:38.226100 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fbb4e-bc49-450c-b350-232e05a08a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:38.227158 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fbb4e-bc49-450c-b350-232e05a08a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:38.227281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fbb4e-bc49-450c-b350-232e05a08a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:38.227533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fbb4e-bc49-450c-b350-232e05a08a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:38.228725 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fbb4e-bc49-450c-b350-232e05a08a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:38.230155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fbb4e-bc49-450c-b350-232e05a08a00 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:38.285761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1167/2328] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:05:38 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:05:38.287104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e763e-3cb6-45f7-83d0-02259fce1a82 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:38.304041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e763e-3cb6-45f7-83d0-02259fce1a82 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:38.447073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a6729-be9a-4abe-9c54-9fc5defca165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:38.447771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a6729-be9a-4abe-9c54-9fc5defca165 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:38.448425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a6729-be9a-4abe-9c54-9fc5defca165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:38.448738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a6729-be9a-4abe-9c54-9fc5defca165 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:38.450325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a6729-be9a-4abe-9c54-9fc5defca165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:38.452274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a6729-be9a-4abe-9c54-9fc5defca165 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:38.488326 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1162/2329] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:05:38 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:05:38.494995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fbb4e-bc49-450c-b350-232e05a08a00 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:38.518105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fbb4e-bc49-450c-b350-232e05a08a00 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:38.533147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f7c55-72c7-4e53-90ba-612b14de8aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:38.533854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7c55-72c7-4e53-90ba-612b14de8aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:38.534202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7c55-72c7-4e53-90ba-612b14de8aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:38.534555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7c55-72c7-4e53-90ba-612b14de8aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:38.535280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f7c55-72c7-4e53-90ba-612b14de8aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:38.537143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f7c55-72c7-4e53-90ba-612b14de8aaa admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:38.557603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1168/2330] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:38.562204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a6729-be9a-4abe-9c54-9fc5defca165 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:38.575571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a6729-be9a-4abe-9c54-9fc5defca165 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:38.581318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32195fb-13f8-4d34-85b6-ed3b53f791ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:38.582715 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32195fb-13f8-4d34-85b6-ed3b53f791ef admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:38.582715 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32195fb-13f8-4d34-85b6-ed3b53f791ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:38.582715 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32195fb-13f8-4d34-85b6-ed3b53f791ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:38.583602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32195fb-13f8-4d34-85b6-ed3b53f791ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:38.585943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32195fb-13f8-4d34-85b6-ed3b53f791ef admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:38.604749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1163/2331] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:05:38.607620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f7c55-72c7-4e53-90ba-612b14de8aaa admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:38.624276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f7c55-72c7-4e53-90ba-612b14de8aaa admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:38.635794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471f834-fbdc-40cd-ae7f-7352d61fe4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:38.637249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471f834-fbdc-40cd-ae7f-7352d61fe4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:38.637637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471f834-fbdc-40cd-ae7f-7352d61fe4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:38.638058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471f834-fbdc-40cd-ae7f-7352d61fe4e8 admin admin] PATH_INFO: `/v3/projects/f0481fbe44c94cf7889b13409e92d52a/users/abe32c1612a54141a28a0e5f51ae883c/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:38.661665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471f834-fbdc-40cd-ae7f-7352d61fe4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0481fbe44c94cf7889b13409e92d52a, user_id=abe32c1612a54141a28a0e5f51ae883c, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:38.665999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471f834-fbdc-40cd-ae7f-7352d61fe4e8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:38.692520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1169/2332] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:05:38 2022] PUT /identity/v3/projects/f0481fbe44c94cf7889b13409e92d52a/users/abe32c1612a54141a28a0e5f51ae883c/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:38.702304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d4e8f-6be3-4e20-ad46-768be07f0dfe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:38.702636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d4e8f-6be3-4e20-ad46-768be07f0dfe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:38.702858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d4e8f-6be3-4e20-ad46-768be07f0dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:38.769690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-221d4e8f-6be3-4e20-ad46-768be07f0dfe None None] MFA Rules not processed for user `abe32c1612a54141a28a0e5f51ae883c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:38.775422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-221d4e8f-6be3-4e20-ad46-768be07f0dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:38.789259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:38.954380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1164/2333] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:38.967886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471f834-fbdc-40cd-ae7f-7352d61fe4e8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:38.970685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3471f834-fbdc-40cd-ae7f-7352d61fe4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:39.091506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471f834-fbdc-40cd-ae7f-7352d61fe4e8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:39.114588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5744ffe-7b26-4560-a0a4-890dcbf66042 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a710cfeadd004a8bbf932f6bb3b211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:39.136554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744ffe-7b26-4560-a0a4-890dcbf66042 service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:39.136833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744ffe-7b26-4560-a0a4-890dcbf66042 service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:39.137088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744ffe-7b26-4560-a0a4-890dcbf66042 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:39.157732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5744ffe-7b26-4560-a0a4-890dcbf66042 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:39.159116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5744ffe-7b26-4560-a0a4-890dcbf66042 service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:39.204346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1170/2334] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:41.761043 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6fea0-f562-4cd9-899d-a339bb9c06e5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:41.762134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6fea0-f562-4cd9-899d-a339bb9c06e5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:41.762134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6fea0-f562-4cd9-899d-a339bb9c06e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:42.005175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-fff6fea0-f562-4cd9-899d-a339bb9c06e5 None None] MFA Rules not processed for user `381b30cab19b41608e675bc7ebf2da61`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:42.006413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fff6fea0-f562-4cd9-899d-a339bb9c06e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:42.188346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1165/2335] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:42.204854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5744ffe-7b26-4560-a0a4-890dcbf66042 service glance] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:42.220207 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5744ffe-7b26-4560-a0a4-890dcbf66042 service glance] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:42.224987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55737f-87ef-415a-960b-d5e0c55061ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a710cfeadd004a8bbf932f6bb3b211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:42.225727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55737f-87ef-415a-960b-d5e0c55061ca service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:42.226109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55737f-87ef-415a-960b-d5e0c55061ca service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:42.226711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55737f-87ef-415a-960b-d5e0c55061ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:42.231474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bc55737f-87ef-415a-960b-d5e0c55061ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:42.304403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:42.306921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55737f-87ef-415a-960b-d5e0c55061ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:42.309112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55737f-87ef-415a-960b-d5e0c55061ca service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:42.321134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1171/2336] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:05:42.488614 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131677-3f81-4178-bc13-37243b894bcb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:42.488902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131677-3f81-4178-bc13-37243b894bcb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:42.489176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41131677-3f81-4178-bc13-37243b894bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:42.510253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-41131677-3f81-4178-bc13-37243b894bcb None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:42.512110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-41131677-3f81-4178-bc13-37243b894bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:42.595131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1166/2337] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:05:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:42.668724 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55737f-87ef-415a-960b-d5e0c55061ca service glance] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:42.674597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-bc55737f-87ef-415a-960b-d5e0c55061ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:42.759774 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55737f-87ef-415a-960b-d5e0c55061ca service glance] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:42.766001 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906b80-c0e3-4c4e-9710-f308e1a77888 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:42.766719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906b80-c0e3-4c4e-9710-f308e1a77888 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:42.767079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906b80-c0e3-4c4e-9710-f308e1a77888 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:42.767423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906b80-c0e3-4c4e-9710-f308e1a77888 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:42.777081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906b80-c0e3-4c4e-9710-f308e1a77888 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:42.779290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906b80-c0e3-4c4e-9710-f308e1a77888 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:42.788788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1172/2338] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:05:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:05:44.350272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131677-3f81-4178-bc13-37243b894bcb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:44.352101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-41131677-3f81-4178-bc13-37243b894bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:44.408872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:44.439201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41131677-3f81-4178-bc13-37243b894bcb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:44.444774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:44.445514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:44.445890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:44.446264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] PATH_INFO: `/v3/users/3cfcc8015015404087f3c4ff8b8839be` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:44.447613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfcc8015015404087f3c4ff8b8839be)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:44.450178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:44.512952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfcc8015015404087f3c4ff8b8839be'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:44.524128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfcc8015015404087f3c4ff8b8839be'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:44.525716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfcc8015015404087f3c4ff8b8839be'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:44.526459 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfcc8015015404087f3c4ff8b8839be'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:44.545449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfcc8015015404087f3c4ff8b8839be'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:44.574485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1167/2339] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:05:44 2022] DELETE /identity/v3/users/3cfcc8015015404087f3c4ff8b8839be => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:44.575961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eafc9-22a6-456b-a226-485b0e2da83a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:44.576531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eafc9-22a6-456b-a226-485b0e2da83a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:44.576531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eafc9-22a6-456b-a226-485b0e2da83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:44.600485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-109eafc9-22a6-456b-a226-485b0e2da83a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:44.602289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-109eafc9-22a6-456b-a226-485b0e2da83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:44.773587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1173/2340] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:44.780359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:44.791656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:44.901289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646bea4-466f-4b58-bfb0-e0ceba24d058 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:44.906521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf333-d659-49cc-a287-2ee76b45b38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:44.907831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf333-d659-49cc-a287-2ee76b45b38c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:44.908113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf333-d659-49cc-a287-2ee76b45b38c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:44.908387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf333-d659-49cc-a287-2ee76b45b38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:44.929135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bf333-d659-49cc-a287-2ee76b45b38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:44.930795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bf333-d659-49cc-a287-2ee76b45b38c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:44.960656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1168/2341] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:45.539154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109eafc9-22a6-456b-a226-485b0e2da83a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:45.541004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-109eafc9-22a6-456b-a226-485b0e2da83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:45.597175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109eafc9-22a6-456b-a226-485b0e2da83a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:45.609256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:45.611594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:45.612050 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:45.612768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] PATH_INFO: `/v3/projects/4609f644371d4e20915d2c375d1ad256` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:45.614580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4609f644371d4e20915d2c375d1ad256)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:45.618929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:45.708964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4609f644371d4e20915d2c375d1ad256', 'request_id': 'req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:45.758491 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4609f644371d4e20915d2c375d1ad256', 'request_id': 'req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:45.772787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4609f644371d4e20915d2c375d1ad256', 'request_id': 'req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:45.812367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] The token cache is being invalidate because project 4609f644371d4e20915d2c375d1ad256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:05:45.812715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:45.815475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-af4ad038-b3cf-4be4-bc4b-c13bfc44d2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:05:45.837425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1174/2342] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:05:45 2022] DELETE /identity/v3/projects/4609f644371d4e20915d2c375d1ad256 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:05:52.328770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf333-d659-49cc-a287-2ee76b45b38c service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:52.330230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-507bf333-d659-49cc-a287-2ee76b45b38c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:52.420793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf333-d659-49cc-a287-2ee76b45b38c service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:52.450789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:52.508569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0cbdb-1d6f-4762-ad25-a1c83c34ef84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:52.509189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0cbdb-1d6f-4762-ad25-a1c83c34ef84 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:52.509470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0cbdb-1d6f-4762-ad25-a1c83c34ef84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:52.509743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0cbdb-1d6f-4762-ad25-a1c83c34ef84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:52.512348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ecb0cbdb-1d6f-4762-ad25-a1c83c34ef84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:52.599842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0cbdb-1d6f-4762-ad25-a1c83c34ef84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:52.601592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0cbdb-1d6f-4762-ad25-a1c83c34ef84 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:52.614069 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1169/2343] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:05:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:05:54.028009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d385e7-e936-43b1-9c73-45d09ed903e9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:54.028909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d385e7-e936-43b1-9c73-45d09ed903e9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:54.029127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d385e7-e936-43b1-9c73-45d09ed903e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:54.050240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b2d385e7-e936-43b1-9c73-45d09ed903e9 None None] MFA Rules not processed for user `14a354aa586d44ad803850134bb9ec18`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:54.051732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b2d385e7-e936-43b1-9c73-45d09ed903e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:54.055905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:54.114977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1175/2344] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:56.464044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83a063-240e-433d-8d12-5b813b9f4b84 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:56.464817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83a063-240e-433d-8d12-5b813b9f4b84 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:56.465201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83a063-240e-433d-8d12-5b813b9f4b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:56.491532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3a83a063-240e-433d-8d12-5b813b9f4b84 None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:05:56.492941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a83a063-240e-433d-8d12-5b813b9f4b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:56.556783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1170/2345] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:05:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:05:56.575558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d385e7-e936-43b1-9c73-45d09ed903e9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:05:56.577203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b2d385e7-e936-43b1-9c73-45d09ed903e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:05:56.664871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d385e7-e936-43b1-9c73-45d09ed903e9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:05:56.673657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91e465-d45e-4f9e-9556-c46a84538374 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:05:56.674261 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91e465-d45e-4f9e-9556-c46a84538374 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:05:56.674730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91e465-d45e-4f9e-9556-c46a84538374 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:05:56.675170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91e465-d45e-4f9e-9556-c46a84538374 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:05:56.685123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91e465-d45e-4f9e-9556-c46a84538374 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:05:56.687313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91e465-d45e-4f9e-9556-c46a84538374 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:05:56.698880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1176/2346] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:05:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:06:06.548277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=66 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:06.698773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=53 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:16.680666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83a063-240e-433d-8d12-5b813b9f4b84 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:16.683184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3a83a063-240e-433d-8d12-5b813b9f4b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:16.748842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83a063-240e-433d-8d12-5b813b9f4b84 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:16.753273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:16.753899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:16.754180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:16.754455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] PATH_INFO: `/v3/users/abe32c1612a54141a28a0e5f51ae883c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:16.755594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe32c1612a54141a28a0e5f51ae883c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:16.757544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:16.802209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe32c1612a54141a28a0e5f51ae883c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:16.809259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe32c1612a54141a28a0e5f51ae883c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:16.809959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe32c1612a54141a28a0e5f51ae883c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:16.810580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe32c1612a54141a28a0e5f51ae883c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:16.817537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe32c1612a54141a28a0e5f51ae883c'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:16.834895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1171/2347] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:06:16 2022] DELETE /identity/v3/users/abe32c1612a54141a28a0e5f51ae883c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:16.839429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df599dc7-5161-4c0b-9b55-6fa50031216f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:16.839926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df599dc7-5161-4c0b-9b55-6fa50031216f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:16.840058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df599dc7-5161-4c0b-9b55-6fa50031216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:16.858484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-df599dc7-5161-4c0b-9b55-6fa50031216f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:16.859688 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-df599dc7-5161-4c0b-9b55-6fa50031216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:16.917847 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1177/2348] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:16.927394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:16.928826 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:16.987116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec7040-ff35-478e-942c-ecb7c8338811 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:16.991119 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4389709-e83d-40e7-9eca-25fa856eefeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:16.991851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4389709-e83d-40e7-9eca-25fa856eefeb service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:16.992134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4389709-e83d-40e7-9eca-25fa856eefeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:16.992405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4389709-e83d-40e7-9eca-25fa856eefeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:17.002566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4389709-e83d-40e7-9eca-25fa856eefeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:17.004000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4389709-e83d-40e7-9eca-25fa856eefeb service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:17.013654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1172/2349] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:06:17.292782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df599dc7-5161-4c0b-9b55-6fa50031216f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:17.293932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-df599dc7-5161-4c0b-9b55-6fa50031216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:17.308127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df599dc7-5161-4c0b-9b55-6fa50031216f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:17.312906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:17.313690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:17.313977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:17.314260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] PATH_INFO: `/v3/projects/f0481fbe44c94cf7889b13409e92d52a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:17.315539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0481fbe44c94cf7889b13409e92d52a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:17.317477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:17.377329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0481fbe44c94cf7889b13409e92d52a', 'request_id': 'req-2a5b290a-1cda-43c7-a857-7a785456bc5f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:17.384798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0481fbe44c94cf7889b13409e92d52a', 'request_id': 'req-2a5b290a-1cda-43c7-a857-7a785456bc5f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:17.391371 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0481fbe44c94cf7889b13409e92d52a', 'request_id': 'req-2a5b290a-1cda-43c7-a857-7a785456bc5f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:17.403411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] The token cache is being invalidate because project f0481fbe44c94cf7889b13409e92d52a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:06:17.403701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:17.404396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2a5b290a-1cda-43c7-a857-7a785456bc5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:17.405916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1178/2350] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:06:17 2022] DELETE /identity/v3/projects/f0481fbe44c94cf7889b13409e92d52a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:27.009457 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:27.399561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:27.671417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4389709-e83d-40e7-9eca-25fa856eefeb service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:27.673002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f4389709-e83d-40e7-9eca-25fa856eefeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:27.686454 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4389709-e83d-40e7-9eca-25fa856eefeb service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:27.763082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:27.763726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:27.764201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:27.764502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] PATH_INFO: `/v3/users/d7248d37148741a488676b76a0434c1a` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:27.766515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7248d37148741a488676b76a0434c1a)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:27.768578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:27.823210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7248d37148741a488676b76a0434c1a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:27.833453 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7248d37148741a488676b76a0434c1a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:27.834197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7248d37148741a488676b76a0434c1a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:27.834951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7248d37148741a488676b76a0434c1a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:27.845056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7248d37148741a488676b76a0434c1a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:27.865613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1173/2351] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:06:27 2022] DELETE /identity/v3/users/d7248d37148741a488676b76a0434c1a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:27.870162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a446aa0-4e11-4b28-98c0-8414cdf2defb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:27.870515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a446aa0-4e11-4b28-98c0-8414cdf2defb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:27.870823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a446aa0-4e11-4b28-98c0-8414cdf2defb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:27.890478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5a446aa0-4e11-4b28-98c0-8414cdf2defb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:27.891671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5a446aa0-4e11-4b28-98c0-8414cdf2defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:27.950351 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1179/2352] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:27.960142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:27.961782 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:28.019921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cafa55-db6c-4f96-ad6f-3c7891a9b788 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:28.023921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179617d0-dd78-487f-af67-a4fc7bc286dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:28.024692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179617d0-dd78-487f-af67-a4fc7bc286dd service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:28.024840 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179617d0-dd78-487f-af67-a4fc7bc286dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:28.025068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179617d0-dd78-487f-af67-a4fc7bc286dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:28.035256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179617d0-dd78-487f-af67-a4fc7bc286dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:28.036720 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179617d0-dd78-487f-af67-a4fc7bc286dd service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:28.049012 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1174/2353] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:28.607192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a446aa0-4e11-4b28-98c0-8414cdf2defb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:28.608753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5a446aa0-4e11-4b28-98c0-8414cdf2defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:28.621767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a446aa0-4e11-4b28-98c0-8414cdf2defb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:28.626710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:28.627203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:28.627495 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:28.627759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] PATH_INFO: `/v3/projects/3467cf11a40a4a5bac246c3f5cade2be` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:28.628948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3467cf11a40a4a5bac246c3f5cade2be)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:28.630899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:28.679273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3467cf11a40a4a5bac246c3f5cade2be', 'request_id': 'req-c38e6058-f209-497c-80ba-0f00a4ae872b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:28.686555 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3467cf11a40a4a5bac246c3f5cade2be', 'request_id': 'req-c38e6058-f209-497c-80ba-0f00a4ae872b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:28.693682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3467cf11a40a4a5bac246c3f5cade2be', 'request_id': 'req-c38e6058-f209-497c-80ba-0f00a4ae872b'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:28.704554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] The token cache is being invalidate because project 3467cf11a40a4a5bac246c3f5cade2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:06:28.704843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:28.705490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c38e6058-f209-497c-80ba-0f00a4ae872b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:28.706978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1180/2354] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:06:28 2022] DELETE /identity/v3/projects/3467cf11a40a4a5bac246c3f5cade2be => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:06:28.712038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c2a79-fa0f-41c0-9141-ad0b9d4785e1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:28.712326 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c2a79-fa0f-41c0-9141-ad0b9d4785e1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:28.713170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c2a79-fa0f-41c0-9141-ad0b9d4785e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:28.733451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-933c2a79-fa0f-41c0-9141-ad0b9d4785e1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:28.734605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-933c2a79-fa0f-41c0-9141-ad0b9d4785e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:28.753285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:28.800380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1175/2355] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:06:28.809247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645a2d-d5cc-4369-ab40-0682ec514d55 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:28.809536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645a2d-d5cc-4369-ab40-0682ec514d55 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:28.809816 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645a2d-d5cc-4369-ab40-0682ec514d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:28.830218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-86645a2d-d5cc-4369-ab40-0682ec514d55 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:28.831424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-86645a2d-d5cc-4369-ab40-0682ec514d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:28.839713 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1181/2356] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:28.843920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c2a79-fa0f-41c0-9141-ad0b9d4785e1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:28.854768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c2a79-fa0f-41c0-9141-ad0b9d4785e1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:28.859363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01023a0a-8401-44b2-b9ef-a098bc2a796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:28.859965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01023a0a-8401-44b2-b9ef-a098bc2a796e admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:28.860245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01023a0a-8401-44b2-b9ef-a098bc2a796e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:28.860543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01023a0a-8401-44b2-b9ef-a098bc2a796e admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:28.861190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01023a0a-8401-44b2-b9ef-a098bc2a796e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:06:28.861496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01023a0a-8401-44b2-b9ef-a098bc2a796e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:28.863086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01023a0a-8401-44b2-b9ef-a098bc2a796e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:28.874664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1176/2357] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:06:28.878860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86645a2d-d5cc-4369-ab40-0682ec514d55 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:28.889228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86645a2d-d5cc-4369-ab40-0682ec514d55 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:28.893422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6fb3-dc2e-4d6e-b67e-5c12e6adb2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:28.894027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6fb3-dc2e-4d6e-b67e-5c12e6adb2bd admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:28.894306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6fb3-dc2e-4d6e-b67e-5c12e6adb2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:28.894579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6fb3-dc2e-4d6e-b67e-5c12e6adb2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:28.895241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d6fb3-dc2e-4d6e-b67e-5c12e6adb2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:28.897303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d6fb3-dc2e-4d6e-b67e-5c12e6adb2bd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:28.926178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1182/2358] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:06:28 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:06:28.930462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01023a0a-8401-44b2-b9ef-a098bc2a796e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:28.941150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01023a0a-8401-44b2-b9ef-a098bc2a796e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:28.998708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be372e-d08e-42c9-9d8b-78a59d6edd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:28.999249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be372e-d08e-42c9-9d8b-78a59d6edd29 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:28.999525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be372e-d08e-42c9-9d8b-78a59d6edd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:28.999797 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be372e-d08e-42c9-9d8b-78a59d6edd29 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:29.000425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be372e-d08e-42c9-9d8b-78a59d6edd29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:29.002368 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be372e-d08e-42c9-9d8b-78a59d6edd29 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:29.026423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1177/2359] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:06:28 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:06:29.030438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6fb3-dc2e-4d6e-b67e-5c12e6adb2bd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:29.041854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6fb3-dc2e-4d6e-b67e-5c12e6adb2bd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:29.047221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7941f-b45d-4a3b-bd5c-9c08c37e8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:29.047960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7941f-b45d-4a3b-bd5c-9c08c37e8a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:29.048244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7941f-b45d-4a3b-bd5c-9c08c37e8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:29.048556 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7941f-b45d-4a3b-bd5c-9c08c37e8a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:29.049271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7941f-b45d-4a3b-bd5c-9c08c37e8a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:29.051136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7941f-b45d-4a3b-bd5c-9c08c37e8a63 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:29.063230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1183/2360] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:06:29.068577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be372e-d08e-42c9-9d8b-78a59d6edd29 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:29.079986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be372e-d08e-42c9-9d8b-78a59d6edd29 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:29.085075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bd465-5637-44e4-8fec-63d46b5399dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:29.085685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bd465-5637-44e4-8fec-63d46b5399dc admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:29.085971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bd465-5637-44e4-8fec-63d46b5399dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:29.086247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bd465-5637-44e4-8fec-63d46b5399dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:29.086897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bd465-5637-44e4-8fec-63d46b5399dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:29.089105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22bd465-5637-44e4-8fec-63d46b5399dc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:29.100836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1178/2361] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:06:29.105539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7941f-b45d-4a3b-bd5c-9c08c37e8a63 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:29.118727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7941f-b45d-4a3b-bd5c-9c08c37e8a63 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:29.122965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb4ff-abd3-45cf-9d89-7e79a52580b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:29.123651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb4ff-abd3-45cf-9d89-7e79a52580b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:29.124297 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb4ff-abd3-45cf-9d89-7e79a52580b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:29.124754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb4ff-abd3-45cf-9d89-7e79a52580b5 admin admin] PATH_INFO: `/v3/projects/62c9d0a785d54f3f85240f09bf163302/users/b797c6fe192c482199a2a474d2fe84a8/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:29.143442 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3eb4ff-abd3-45cf-9d89-7e79a52580b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c9d0a785d54f3f85240f09bf163302, user_id=b797c6fe192c482199a2a474d2fe84a8, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:29.146226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3eb4ff-abd3-45cf-9d89-7e79a52580b5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:29.166395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1184/2362] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:06:29 2022] PUT /identity/v3/projects/62c9d0a785d54f3f85240f09bf163302/users/b797c6fe192c482199a2a474d2fe84a8/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:29.178489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925acf-2016-46c0-8bf1-8b2a59df4d6f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:29.178968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925acf-2016-46c0-8bf1-8b2a59df4d6f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:29.179111 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925acf-2016-46c0-8bf1-8b2a59df4d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:29.211687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6b925acf-2016-46c0-8bf1-8b2a59df4d6f None None] MFA Rules not processed for user `b797c6fe192c482199a2a474d2fe84a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:29.213629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6b925acf-2016-46c0-8bf1-8b2a59df4d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:29.279675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1179/2363] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:29.290984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb4ff-abd3-45cf-9d89-7e79a52580b5 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:29.292853 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ab3eb4ff-abd3-45cf-9d89-7e79a52580b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:29.316562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:29.356877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb4ff-abd3-45cf-9d89-7e79a52580b5 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:29.360559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c753c2-fe84-4a5a-9d2f-9b941ae09df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:29.361169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c753c2-fe84-4a5a-9d2f-9b941ae09df5 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:29.361445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c753c2-fe84-4a5a-9d2f-9b941ae09df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:29.361714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c753c2-fe84-4a5a-9d2f-9b941ae09df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:29.370862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c753c2-fe84-4a5a-9d2f-9b941ae09df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:29.372286 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c753c2-fe84-4a5a-9d2f-9b941ae09df5 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:29.381595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1185/2364] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:30.752310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400166e-1e15-40f8-b405-ac384b9ea515 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:30.752845 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400166e-1e15-40f8-b405-ac384b9ea515 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:30.752960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400166e-1e15-40f8-b405-ac384b9ea515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:30.775723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6400166e-1e15-40f8-b405-ac384b9ea515 None None] MFA Rules not processed for user `b797c6fe192c482199a2a474d2fe84a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:30.776966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6400166e-1e15-40f8-b405-ac384b9ea515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:30.783761 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1180/2365] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:39.018040 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e34fd-0a3d-4c8c-ba68-b7dffb6d09e3 None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:39.018954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e34fd-0a3d-4c8c-ba68-b7dffb6d09e3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:39.019397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e34fd-0a3d-4c8c-ba68-b7dffb6d09e3 None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:39.021743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1186/2366] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:06:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:06:39.029145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaefbe-12d7-4069-980f-a174f3cf42cf None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:39.029686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaefbe-12d7-4069-980f-a174f3cf42cf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:39.029686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaefbe-12d7-4069-980f-a174f3cf42cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:39.051348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6abaefbe-12d7-4069-980f-a174f3cf42cf None None] MFA Rules not processed for user `4cc1ad7e47454b5d9d2ef2190414010c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:39.052675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6abaefbe-12d7-4069-980f-a174f3cf42cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:39.058255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:39.138821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1181/2367] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:06:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:39.159349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e34fd-0a3d-4c8c-ba68-b7dffb6d09e3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:39.162150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-429e34fd-0a3d-4c8c-ba68-b7dffb6d09e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:39.181344 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e34fd-0a3d-4c8c-ba68-b7dffb6d09e3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:39.187030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27037df6-4d3b-44f5-9cf6-9c7b29a35eeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:39.187719 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27037df6-4d3b-44f5-9cf6-9c7b29a35eeb service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:39.188086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27037df6-4d3b-44f5-9cf6-9c7b29a35eeb service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:39.188432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27037df6-4d3b-44f5-9cf6-9c7b29a35eeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:39.199327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27037df6-4d3b-44f5-9cf6-9c7b29a35eeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:39.201230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27037df6-4d3b-44f5-9cf6-9c7b29a35eeb service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:39.211121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1187/2368] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:39.719321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaefbe-12d7-4069-980f-a174f3cf42cf None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:39.720770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6abaefbe-12d7-4069-980f-a174f3cf42cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:39.790102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaefbe-12d7-4069-980f-a174f3cf42cf None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:39.795825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:39.796493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:39.796774 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:39.797046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] PATH_INFO: `/v3/users/fcfa895d5e4f4f0f95e1740897daf0f1` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:39.798287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcfa895d5e4f4f0f95e1740897daf0f1)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:39.800384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:39.850934 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcfa895d5e4f4f0f95e1740897daf0f1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:39.858981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcfa895d5e4f4f0f95e1740897daf0f1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:39.859594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcfa895d5e4f4f0f95e1740897daf0f1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:39.860192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcfa895d5e4f4f0f95e1740897daf0f1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:39.867114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcfa895d5e4f4f0f95e1740897daf0f1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:39.884544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1182/2369] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:06:39 2022] DELETE /identity/v3/users/fcfa895d5e4f4f0f95e1740897daf0f1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:06:40.068870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27037df6-4d3b-44f5-9cf6-9c7b29a35eeb service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:40.076881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27037df6-4d3b-44f5-9cf6-9c7b29a35eeb service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:40.139206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:40.139872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:40.140140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:40.140411 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] PATH_INFO: `/v3/projects/658319adae7543c98960359c02378613` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:40.141611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=658319adae7543c98960359c02378613)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:40.143721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:40.202215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658319adae7543c98960359c02378613', 'request_id': 'req-845b4a69-c7fd-4c13-8964-4321b1402439'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.210299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658319adae7543c98960359c02378613', 'request_id': 'req-845b4a69-c7fd-4c13-8964-4321b1402439'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.217236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658319adae7543c98960359c02378613', 'request_id': 'req-845b4a69-c7fd-4c13-8964-4321b1402439'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.230073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] The token cache is being invalidate because project 658319adae7543c98960359c02378613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:06:40.230379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.231036 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.233646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1188/2370] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:06:40 2022] DELETE /identity/v3/projects/658319adae7543c98960359c02378613 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:40.237799 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:40.239219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:40.262182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe1b74-daf1-4ec6-99a0-552bb528d63d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:40.291575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:40.329264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:40.330449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:40.330449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:40.330449 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] PATH_INFO: `/v3/users/3aca35b1b0cc49f497b8ba262e574223` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:40.331585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aca35b1b0cc49f497b8ba262e574223)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:40.333560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:40.399445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aca35b1b0cc49f497b8ba262e574223'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.408864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aca35b1b0cc49f497b8ba262e574223'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.409599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aca35b1b0cc49f497b8ba262e574223'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.410528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aca35b1b0cc49f497b8ba262e574223'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.423778 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f250b0c2-6922-4403-b9aa-8de70782a6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aca35b1b0cc49f497b8ba262e574223'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.444605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1183/2371] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:06:40 2022] DELETE /identity/v3/users/3aca35b1b0cc49f497b8ba262e574223 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:40.632775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:40.634245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:40.647747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b4a69-c7fd-4c13-8964-4321b1402439 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:40.686058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:40.706896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:40.707904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:40.708009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:40.708189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] PATH_INFO: `/v3/projects/985a141b0fa54741b62ad288ce963105` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:40.709435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985a141b0fa54741b62ad288ce963105)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:40.711384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:40.769168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985a141b0fa54741b62ad288ce963105', 'request_id': 'req-960f96db-6432-4258-9d98-8f69457a66a2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.777094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985a141b0fa54741b62ad288ce963105', 'request_id': 'req-960f96db-6432-4258-9d98-8f69457a66a2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.783694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985a141b0fa54741b62ad288ce963105', 'request_id': 'req-960f96db-6432-4258-9d98-8f69457a66a2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.795022 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] The token cache is being invalidate because project 985a141b0fa54741b62ad288ce963105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:06:40.795314 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.795954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-960f96db-6432-4258-9d98-8f69457a66a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:40.797880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1189/2372] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:06:40 2022] DELETE /identity/v3/projects/985a141b0fa54741b62ad288ce963105 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:40.802778 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22757f-6bf7-4f40-a9db-742d00e84a5e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:40.803079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22757f-6bf7-4f40-a9db-742d00e84a5e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:40.803362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22757f-6bf7-4f40-a9db-742d00e84a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:40.824253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3f22757f-6bf7-4f40-a9db-742d00e84a5e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:40.825538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3f22757f-6bf7-4f40-a9db-742d00e84a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:40.889777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1184/2373] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:40.897673 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4319111-62e4-45dc-8e83-7aebf9bae592 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:40.897971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4319111-62e4-45dc-8e83-7aebf9bae592 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:40.898253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4319111-62e4-45dc-8e83-7aebf9bae592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:40.918348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f4319111-62e4-45dc-8e83-7aebf9bae592 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:40.919563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f4319111-62e4-45dc-8e83-7aebf9bae592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:40.927445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1190/2374] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:40.932266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22757f-6bf7-4f40-a9db-742d00e84a5e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:40.941817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22757f-6bf7-4f40-a9db-742d00e84a5e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:40.946302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed7d24-ff6e-499b-b0d9-b9d32fd7109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:40.947021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed7d24-ff6e-499b-b0d9-b9d32fd7109f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:40.947304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed7d24-ff6e-499b-b0d9-b9d32fd7109f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:40.947578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed7d24-ff6e-499b-b0d9-b9d32fd7109f admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:40.948242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed7d24-ff6e-499b-b0d9-b9d32fd7109f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:06:40.948578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed7d24-ff6e-499b-b0d9-b9d32fd7109f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:40.950204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed7d24-ff6e-499b-b0d9-b9d32fd7109f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:40.961867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1185/2375] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 17:06:40.966256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4319111-62e4-45dc-8e83-7aebf9bae592 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:40.975897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4319111-62e4-45dc-8e83-7aebf9bae592 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:40.982954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c539f-39fb-4fbf-bf95-f5cbe9e2595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:40.983550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c539f-39fb-4fbf-bf95-f5cbe9e2595f admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:40.983828 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c539f-39fb-4fbf-bf95-f5cbe9e2595f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:40.984100 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c539f-39fb-4fbf-bf95-f5cbe9e2595f admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:40.984755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c539f-39fb-4fbf-bf95-f5cbe9e2595f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:40.986640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c539f-39fb-4fbf-bf95-f5cbe9e2595f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.013957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1191/2376] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:06:40 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:06:41.018304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed7d24-ff6e-499b-b0d9-b9d32fd7109f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.028349 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed7d24-ff6e-499b-b0d9-b9d32fd7109f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:41.058600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:41.090502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e2658-1b41-44bf-b84a-2e3dea535895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:41.091118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2658-1b41-44bf-b84a-2e3dea535895 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.091459 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2658-1b41-44bf-b84a-2e3dea535895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.091655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e2658-1b41-44bf-b84a-2e3dea535895 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.092279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e2658-1b41-44bf-b84a-2e3dea535895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:41.094218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e2658-1b41-44bf-b84a-2e3dea535895 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.116527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1186/2377] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:06:41 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:06:41.121212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c539f-39fb-4fbf-bf95-f5cbe9e2595f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.132403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c539f-39fb-4fbf-bf95-f5cbe9e2595f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:41.137775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67046fb-acf3-4d0d-909f-bbb0e49457d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:41.138398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67046fb-acf3-4d0d-909f-bbb0e49457d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.138680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67046fb-acf3-4d0d-909f-bbb0e49457d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.138954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67046fb-acf3-4d0d-909f-bbb0e49457d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.139600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67046fb-acf3-4d0d-909f-bbb0e49457d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:41.141246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67046fb-acf3-4d0d-909f-bbb0e49457d9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.152530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1192/2378] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:06:41.156518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e2658-1b41-44bf-b84a-2e3dea535895 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.166515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e2658-1b41-44bf-b84a-2e3dea535895 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:41.171077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35810cb4-b8b0-4ba8-9c5a-4d97c3e4fdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:41.171680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35810cb4-b8b0-4ba8-9c5a-4d97c3e4fdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.171957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35810cb4-b8b0-4ba8-9c5a-4d97c3e4fdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.172238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35810cb4-b8b0-4ba8-9c5a-4d97c3e4fdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.172900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35810cb4-b8b0-4ba8-9c5a-4d97c3e4fdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:41.174507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35810cb4-b8b0-4ba8-9c5a-4d97c3e4fdd7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.184322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1187/2379] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:06:41.188543 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67046fb-acf3-4d0d-909f-bbb0e49457d9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.198976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67046fb-acf3-4d0d-909f-bbb0e49457d9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:41.204182 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7d88f-917e-4690-8ce3-2f4545604120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:41.204978 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d88f-917e-4690-8ce3-2f4545604120 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.205262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d88f-917e-4690-8ce3-2f4545604120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.205540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d88f-917e-4690-8ce3-2f4545604120 admin admin] PATH_INFO: `/v3/projects/f28d0598eb98426d98e622400b963add/users/8d04fac510fd4f25b7417c554999eab0/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.220708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7d88f-917e-4690-8ce3-2f4545604120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f28d0598eb98426d98e622400b963add, user_id=8d04fac510fd4f25b7417c554999eab0, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:41.223320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7d88f-917e-4690-8ce3-2f4545604120 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.236121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1193/2380] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:06:41 2022] PUT /identity/v3/projects/f28d0598eb98426d98e622400b963add/users/8d04fac510fd4f25b7417c554999eab0/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:41.246569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e8b8-ee28-4487-b415-5e487ef34933 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.247049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e8b8-ee28-4487-b415-5e487ef34933 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.247145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e8b8-ee28-4487-b415-5e487ef34933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.280445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-8199e8b8-ee28-4487-b415-5e487ef34933 None None] MFA Rules not processed for user `8d04fac510fd4f25b7417c554999eab0`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:41.283100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8199e8b8-ee28-4487-b415-5e487ef34933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:41.358415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1188/2381] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:06:41.362894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7d88f-917e-4690-8ce3-2f4545604120 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.437024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7d88f-917e-4690-8ce3-2f4545604120 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:41.442763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecd6fa-9fba-4aeb-ba5f-5bfb4e41338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:41.444027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecd6fa-9fba-4aeb-ba5f-5bfb4e41338d admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.444027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecd6fa-9fba-4aeb-ba5f-5bfb4e41338d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.444347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecd6fa-9fba-4aeb-ba5f-5bfb4e41338d admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.445203 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecd6fa-9fba-4aeb-ba5f-5bfb4e41338d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:41.448715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecd6fa-9fba-4aeb-ba5f-5bfb4e41338d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.462614 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:41.487054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1194/2382] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:06:41 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:06:41.491321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199e8b8-ee28-4487-b415-5e487ef34933 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.503693 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199e8b8-ee28-4487-b415-5e487ef34933 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:41.569185 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878da19-1e00-4ff9-9e76-64c3a8d999e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:41.569846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878da19-1e00-4ff9-9e76-64c3a8d999e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.570128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878da19-1e00-4ff9-9e76-64c3a8d999e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.570400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878da19-1e00-4ff9-9e76-64c3a8d999e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.571032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878da19-1e00-4ff9-9e76-64c3a8d999e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:41.573710 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878da19-1e00-4ff9-9e76-64c3a8d999e8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.601141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1189/2383] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:06:41 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:06:41.605560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecd6fa-9fba-4aeb-ba5f-5bfb4e41338d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.616630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecd6fa-9fba-4aeb-ba5f-5bfb4e41338d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:41.621623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7e7c-a65b-4a04-8072-03f98f0abf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:41.622238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7e7c-a65b-4a04-8072-03f98f0abf7a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.622521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7e7c-a65b-4a04-8072-03f98f0abf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.622799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae7e7c-a65b-4a04-8072-03f98f0abf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.623453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae7e7c-a65b-4a04-8072-03f98f0abf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:41.625117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae7e7c-a65b-4a04-8072-03f98f0abf7a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.640310 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1195/2384] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:06:41.644767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878da19-1e00-4ff9-9e76-64c3a8d999e8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.656070 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878da19-1e00-4ff9-9e76-64c3a8d999e8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:41.660885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d5331-c88f-4bab-8815-902aa832c45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:41.661548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5331-c88f-4bab-8815-902aa832c45d admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.661825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5331-c88f-4bab-8815-902aa832c45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.662098 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5331-c88f-4bab-8815-902aa832c45d admin admin] PATH_INFO: `/v3/projects/c9b895e2e9274610850b436db20f83e2/users/5883cf16c9624dd0ad3a8a71cfc0b917/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.678372 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d5331-c88f-4bab-8815-902aa832c45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b895e2e9274610850b436db20f83e2, user_id=5883cf16c9624dd0ad3a8a71cfc0b917, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:41.681019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d5331-c88f-4bab-8815-902aa832c45d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.693948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1190/2385] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:06:41 2022] PUT /identity/v3/projects/c9b895e2e9274610850b436db20f83e2/users/5883cf16c9624dd0ad3a8a71cfc0b917/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:41.698901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7e7c-a65b-4a04-8072-03f98f0abf7a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.709494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae7e7c-a65b-4a04-8072-03f98f0abf7a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:41.775904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb199a-d78d-4181-97d9-4b4e323a113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:41.776681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb199a-d78d-4181-97d9-4b4e323a113a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.777167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb199a-d78d-4181-97d9-4b4e323a113a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.777370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb199a-d78d-4181-97d9-4b4e323a113a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.778583 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb199a-d78d-4181-97d9-4b4e323a113a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:41.780831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb199a-d78d-4181-97d9-4b4e323a113a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.792740 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1196/2386] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:06:41.796770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d5331-c88f-4bab-8815-902aa832c45d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.808165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d5331-c88f-4bab-8815-902aa832c45d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:41.812825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c58c8-e416-499a-8bcb-ca48772f21c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:41.813477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c58c8-e416-499a-8bcb-ca48772f21c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.813862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c58c8-e416-499a-8bcb-ca48772f21c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.814142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c58c8-e416-499a-8bcb-ca48772f21c8 admin admin] PATH_INFO: `/v3/projects/c9b895e2e9274610850b436db20f83e2/users/5883cf16c9624dd0ad3a8a71cfc0b917/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.816024 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c58c8-e416-499a-8bcb-ca48772f21c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b895e2e9274610850b436db20f83e2, user_id=5883cf16c9624dd0ad3a8a71cfc0b917, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:41.818630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c58c8-e416-499a-8bcb-ca48772f21c8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:41.820925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:41.831722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1191/2387] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:06:41 2022] PUT /identity/v3/projects/c9b895e2e9274610850b436db20f83e2/users/5883cf16c9624dd0ad3a8a71cfc0b917/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:41.843662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f89c3-2df2-41a6-bd8f-71702e72cffd None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:41.843948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f89c3-2df2-41a6-bd8f-71702e72cffd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:41.844223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f89c3-2df2-41a6-bd8f-71702e72cffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:41.873854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0a5f89c3-2df2-41a6-bd8f-71702e72cffd None None] MFA Rules not processed for user `5883cf16c9624dd0ad3a8a71cfc0b917`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:41.875496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0a5f89c3-2df2-41a6-bd8f-71702e72cffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:41.986615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1197/2388] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:41.997881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c58c8-e416-499a-8bcb-ca48772f21c8 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:41.999613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d21c58c8-e416-499a-8bcb-ca48772f21c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:42.065804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c58c8-e416-499a-8bcb-ca48772f21c8 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:42.069460 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40e0fe-84f5-4eef-942b-ee530a2de052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:42.070082 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40e0fe-84f5-4eef-942b-ee530a2de052 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:42.070482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40e0fe-84f5-4eef-942b-ee530a2de052 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:42.070721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40e0fe-84f5-4eef-942b-ee530a2de052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:42.127422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40e0fe-84f5-4eef-942b-ee530a2de052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:42.128925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40e0fe-84f5-4eef-942b-ee530a2de052 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:42.138035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1192/2389] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:44.598468 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f89c3-2df2-41a6-bd8f-71702e72cffd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:44.600424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0a5f89c3-2df2-41a6-bd8f-71702e72cffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:44.659028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f89c3-2df2-41a6-bd8f-71702e72cffd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:44.662745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4613196-b365-46c0-b807-5c44d40849df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:44.663355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4613196-b365-46c0-b807-5c44d40849df service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:44.663634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4613196-b365-46c0-b807-5c44d40849df service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:44.663935 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4613196-b365-46c0-b807-5c44d40849df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:44.666198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e4613196-b365-46c0-b807-5c44d40849df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:44.679594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:44.730564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4613196-b365-46c0-b807-5c44d40849df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:44.732005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4613196-b365-46c0-b807-5c44d40849df service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:44.741951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1198/2390] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:46.562153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40e0fe-84f5-4eef-942b-ee530a2de052 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:46.564192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5a40e0fe-84f5-4eef-942b-ee530a2de052 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:46.582326 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40e0fe-84f5-4eef-942b-ee530a2de052 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:46.593587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fe7b5-79c7-4da3-a99d-463a84d92033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:46.594218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe7b5-79c7-4da3-a99d-463a84d92033 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:46.594503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe7b5-79c7-4da3-a99d-463a84d92033 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:46.594900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe7b5-79c7-4da3-a99d-463a84d92033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:46.611635 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fe7b5-79c7-4da3-a99d-463a84d92033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:46.614333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fe7b5-79c7-4da3-a99d-463a84d92033 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:46.655267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1193/2391] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:51.830241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4613196-b365-46c0-b807-5c44d40849df service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:51.893072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4613196-b365-46c0-b807-5c44d40849df service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:51.896723 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:51.897359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:51.897641 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:51.897916 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] PATH_INFO: `/v3/users/8d04fac510fd4f25b7417c554999eab0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:51.899024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d04fac510fd4f25b7417c554999eab0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:51.901523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:51.947444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d04fac510fd4f25b7417c554999eab0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:51.948109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d04fac510fd4f25b7417c554999eab0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:51.959830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d04fac510fd4f25b7417c554999eab0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:51.967138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d04fac510fd4f25b7417c554999eab0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:51.967771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d04fac510fd4f25b7417c554999eab0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:51.981465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1199/2392] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:06:51 2022] DELETE /identity/v3/users/8d04fac510fd4f25b7417c554999eab0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:51.986263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c77d9-bb46-43fd-8e4d-4c725c29aabe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:51.986995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c77d9-bb46-43fd-8e4d-4c725c29aabe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:51.987241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c77d9-bb46-43fd-8e4d-4c725c29aabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:52.011918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-449c77d9-bb46-43fd-8e4d-4c725c29aabe None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:52.013138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-449c77d9-bb46-43fd-8e4d-4c725c29aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:52.090953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1194/2393] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:52.092100 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:52.093793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:52.140568 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:52.174087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf779548-63d6-43aa-abc5-ece843f26d4e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:52.178168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad8b58-3222-48d0-9d60-a90937d0f80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:52.178863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8b58-3222-48d0-9d60-a90937d0f80f service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:52.179146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8b58-3222-48d0-9d60-a90937d0f80f service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:52.179423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8b58-3222-48d0-9d60-a90937d0f80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:52.189921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad8b58-3222-48d0-9d60-a90937d0f80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:52.191506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad8b58-3222-48d0-9d60-a90937d0f80f service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:52.201084 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1200/2394] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:52.778182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c77d9-bb46-43fd-8e4d-4c725c29aabe None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:52.779638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-449c77d9-bb46-43fd-8e4d-4c725c29aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:52.801583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c77d9-bb46-43fd-8e4d-4c725c29aabe None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:52.817396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:52.818169 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:52.818528 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:52.818882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] PATH_INFO: `/v3/projects/f28d0598eb98426d98e622400b963add` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:52.820196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f28d0598eb98426d98e622400b963add)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:52.822385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:52.865305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:52.880514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28d0598eb98426d98e622400b963add', 'request_id': 'req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:52.887586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28d0598eb98426d98e622400b963add', 'request_id': 'req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:52.895361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28d0598eb98426d98e622400b963add', 'request_id': 'req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:52.909102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] The token cache is being invalidate because project f28d0598eb98426d98e622400b963add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:06:52.909389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:52.910041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:52.911534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1195/2395] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:06:52 2022] DELETE /identity/v3/projects/f28d0598eb98426d98e622400b963add => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:52.916258 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad8b58-3222-48d0-9d60-a90937d0f80f service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:52.926380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad8b58-3222-48d0-9d60-a90937d0f80f service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:52.985082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:52.985718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:52.986000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:52.986279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] PATH_INFO: `/v3/users/5883cf16c9624dd0ad3a8a71cfc0b917` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:52.987399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5883cf16c9624dd0ad3a8a71cfc0b917)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:52.989355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:53.034065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5883cf16c9624dd0ad3a8a71cfc0b917'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:53.034720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5883cf16c9624dd0ad3a8a71cfc0b917'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:53.047206 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5883cf16c9624dd0ad3a8a71cfc0b917'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:53.053939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5883cf16c9624dd0ad3a8a71cfc0b917'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:53.054626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-3958b0c9-28a9-4032-9899-2f079192cdf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5883cf16c9624dd0ad3a8a71cfc0b917'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:53.068589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1201/2396] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:06:52 2022] DELETE /identity/v3/users/5883cf16c9624dd0ad3a8a71cfc0b917 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:06:53.444236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:53.446404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:53.461631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ea2bd-cbb8-48a5-8944-0508ad43c3d3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:53.533416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:53.534047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:53.534330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:53.534600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] PATH_INFO: `/v3/projects/c9b895e2e9274610850b436db20f83e2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:53.535735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b895e2e9274610850b436db20f83e2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:53.537675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:53.584429 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b895e2e9274610850b436db20f83e2', 'request_id': 'req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:53.592071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b895e2e9274610850b436db20f83e2', 'request_id': 'req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:53.599038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b895e2e9274610850b436db20f83e2', 'request_id': 'req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:53.611784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] The token cache is being invalidate because project c9b895e2e9274610850b436db20f83e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:06:53.612110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:53.612751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-069cad88-6804-4bc6-9fef-dff2a2ac2d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:53.614225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1196/2397] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:06:53 2022] DELETE /identity/v3/projects/c9b895e2e9274610850b436db20f83e2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:53.620137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c1f9-f9e5-4c56-9292-d2fbb44b59ec None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:53.620433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c1f9-f9e5-4c56-9292-d2fbb44b59ec None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:53.620777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c1f9-f9e5-4c56-9292-d2fbb44b59ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:53.641085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-fe52c1f9-f9e5-4c56-9292-d2fbb44b59ec None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:53.642299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-fe52c1f9-f9e5-4c56-9292-d2fbb44b59ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:53.689235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:53.706526 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1202/2398] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:06:53.720271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534cdd-302b-44f7-af5e-f69806e558b1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:53.720644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534cdd-302b-44f7-af5e-f69806e558b1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:53.720954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d534cdd-302b-44f7-af5e-f69806e558b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:53.741737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-6d534cdd-302b-44f7-af5e-f69806e558b1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:53.742700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6d534cdd-302b-44f7-af5e-f69806e558b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:53.750599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1197/2399] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:53.754797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52c1f9-f9e5-4c56-9292-d2fbb44b59ec None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:53.768317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52c1f9-f9e5-4c56-9292-d2fbb44b59ec None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:53.773225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05a55e-180e-4093-b91f-dd3e10e427a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:53.773836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a55e-180e-4093-b91f-dd3e10e427a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:53.774113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a55e-180e-4093-b91f-dd3e10e427a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:53.774384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a55e-180e-4093-b91f-dd3e10e427a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:53.775617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05a55e-180e-4093-b91f-dd3e10e427a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:06:53.775918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05a55e-180e-4093-b91f-dd3e10e427a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:53.777549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05a55e-180e-4093-b91f-dd3e10e427a3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:53.794287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1203/2400] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:06:53.795879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d534cdd-302b-44f7-af5e-f69806e558b1 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:53.805229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d534cdd-302b-44f7-af5e-f69806e558b1 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:53.810386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf03bf-7b89-46be-b7fa-4a3ff970752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:53.810981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf03bf-7b89-46be-b7fa-4a3ff970752d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:53.811260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf03bf-7b89-46be-b7fa-4a3ff970752d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:53.811532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf03bf-7b89-46be-b7fa-4a3ff970752d admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:53.812150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf03bf-7b89-46be-b7fa-4a3ff970752d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:53.814121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf03bf-7b89-46be-b7fa-4a3ff970752d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:53.841841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1198/2401] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:06:53 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:06:53.846111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05a55e-180e-4093-b91f-dd3e10e427a3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:53.857547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05a55e-180e-4093-b91f-dd3e10e427a3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:53.917834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1a39a-dd33-4cda-b974-2df2ce494a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:53.918528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1a39a-dd33-4cda-b974-2df2ce494a21 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:53.918721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1a39a-dd33-4cda-b974-2df2ce494a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:53.918996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1a39a-dd33-4cda-b974-2df2ce494a21 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:53.919642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1a39a-dd33-4cda-b974-2df2ce494a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:53.921593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1a39a-dd33-4cda-b974-2df2ce494a21 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:53.945077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1204/2402] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:06:53 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:06:53.949221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf03bf-7b89-46be-b7fa-4a3ff970752d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:53.959594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf03bf-7b89-46be-b7fa-4a3ff970752d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:53.964369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b27b9a-0e4d-45aa-a958-caf55cd525b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:53.965006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b27b9a-0e4d-45aa-a958-caf55cd525b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:53.965286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b27b9a-0e4d-45aa-a958-caf55cd525b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:53.965559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b27b9a-0e4d-45aa-a958-caf55cd525b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:53.966252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b27b9a-0e4d-45aa-a958-caf55cd525b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:53.967832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b27b9a-0e4d-45aa-a958-caf55cd525b7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:53.978999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1199/2403] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:06:53.982984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1a39a-dd33-4cda-b974-2df2ce494a21 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:53.993364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1a39a-dd33-4cda-b974-2df2ce494a21 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:53.999054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c040371-54d6-42c6-9133-57d9bfb4b4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:53.999667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c040371-54d6-42c6-9133-57d9bfb4b4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:53.999945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c040371-54d6-42c6-9133-57d9bfb4b4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.000621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c040371-54d6-42c6-9133-57d9bfb4b4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.006272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c040371-54d6-42c6-9133-57d9bfb4b4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:54.008717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c040371-54d6-42c6-9133-57d9bfb4b4f2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:54.020779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1205/2404] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:06:54.024204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b27b9a-0e4d-45aa-a958-caf55cd525b7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:54.036165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b27b9a-0e4d-45aa-a958-caf55cd525b7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:54.044287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eac14f-dc24-47cf-aa6d-96ee009a807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:54.044995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac14f-dc24-47cf-aa6d-96ee009a807b admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.045276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac14f-dc24-47cf-aa6d-96ee009a807b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.045552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac14f-dc24-47cf-aa6d-96ee009a807b admin admin] PATH_INFO: `/v3/projects/50d09fa179804c91abc0831c7d50dbc8/users/f20667e137f849d1ad1a1e21badd53f6/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.048904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:54.062923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eac14f-dc24-47cf-aa6d-96ee009a807b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d09fa179804c91abc0831c7d50dbc8, user_id=f20667e137f849d1ad1a1e21badd53f6, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:54.065580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eac14f-dc24-47cf-aa6d-96ee009a807b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:54.079616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1200/2405] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:06:54 2022] PUT /identity/v3/projects/50d09fa179804c91abc0831c7d50dbc8/users/f20667e137f849d1ad1a1e21badd53f6/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:54.091657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211266-52d4-43aa-a1a0-fe2eec4049bb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.091974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211266-52d4-43aa-a1a0-fe2eec4049bb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.092253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211266-52d4-43aa-a1a0-fe2eec4049bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.121905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a5211266-52d4-43aa-a1a0-fe2eec4049bb None None] MFA Rules not processed for user `f20667e137f849d1ad1a1e21badd53f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:54.123121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a5211266-52d4-43aa-a1a0-fe2eec4049bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:54.194195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1206/2406] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:54.199447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eac14f-dc24-47cf-aa6d-96ee009a807b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:54.275381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eac14f-dc24-47cf-aa6d-96ee009a807b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:54.281285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b62248-ba34-4d38-9222-da61fbc10b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:54.282038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b62248-ba34-4d38-9222-da61fbc10b85 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.282237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b62248-ba34-4d38-9222-da61fbc10b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.282513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b62248-ba34-4d38-9222-da61fbc10b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.283438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b62248-ba34-4d38-9222-da61fbc10b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:54.285688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b62248-ba34-4d38-9222-da61fbc10b85 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:54.323762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1201/2407] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:06:54 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:06:54.325363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211266-52d4-43aa-a1a0-fe2eec4049bb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:54.337787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211266-52d4-43aa-a1a0-fe2eec4049bb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:54.392883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:54.407893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b755fef-4e4f-4f1b-ab94-a707cc92e426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:54.408600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b755fef-4e4f-4f1b-ab94-a707cc92e426 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.408898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b755fef-4e4f-4f1b-ab94-a707cc92e426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.409174 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b755fef-4e4f-4f1b-ab94-a707cc92e426 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.409798 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b755fef-4e4f-4f1b-ab94-a707cc92e426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:54.411739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b755fef-4e4f-4f1b-ab94-a707cc92e426 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:54.434594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1207/2408] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:06:54 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:06:54.438753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b62248-ba34-4d38-9222-da61fbc10b85 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:54.449381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b62248-ba34-4d38-9222-da61fbc10b85 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:54.454999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80098e05-a6d8-4744-8ca7-041cf1486d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:54.455932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80098e05-a6d8-4744-8ca7-041cf1486d34 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.456218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80098e05-a6d8-4744-8ca7-041cf1486d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.456523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80098e05-a6d8-4744-8ca7-041cf1486d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.457260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80098e05-a6d8-4744-8ca7-041cf1486d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:54.459000 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80098e05-a6d8-4744-8ca7-041cf1486d34 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:54.470950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1202/2409] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:06:54.475569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b755fef-4e4f-4f1b-ab94-a707cc92e426 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:54.482603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaccf99-d139-44f6-adb4-4af48d8d462a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.482894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaccf99-d139-44f6-adb4-4af48d8d462a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.483169 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaccf99-d139-44f6-adb4-4af48d8d462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.486644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b755fef-4e4f-4f1b-ab94-a707cc92e426 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:54.491548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb6c6c-6adc-4bc9-9cfd-37f262864e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:54.492224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb6c6c-6adc-4bc9-9cfd-37f262864e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.492790 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb6c6c-6adc-4bc9-9cfd-37f262864e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.493156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb6c6c-6adc-4bc9-9cfd-37f262864e2a admin admin] PATH_INFO: `/v3/projects/b008e6e7a95b4d20b854f3433a9a897b/users/ebb5eb87246544a382697b4c73344db9/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.502973 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-feaccf99-d139-44f6-adb4-4af48d8d462a None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:54.504178 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-feaccf99-d139-44f6-adb4-4af48d8d462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:54.510066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb6c6c-6adc-4bc9-9cfd-37f262864e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b008e6e7a95b4d20b854f3433a9a897b, user_id=ebb5eb87246544a382697b4c73344db9, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:54.512824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb6c6c-6adc-4bc9-9cfd-37f262864e2a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:54.527176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1208/2410] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:06:54 2022] PUT /identity/v3/projects/b008e6e7a95b4d20b854f3433a9a897b/users/ebb5eb87246544a382697b4c73344db9/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:54.531541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb6c6c-6adc-4bc9-9cfd-37f262864e2a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:54.563610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1203/2411] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:06:54.586582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaccf99-d139-44f6-adb4-4af48d8d462a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:54.588631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-feaccf99-d139-44f6-adb4-4af48d8d462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:54.600519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb6c6c-6adc-4bc9-9cfd-37f262864e2a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:54.606512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94080110-74c9-47c2-8bfd-294cda47310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:54.607256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94080110-74c9-47c2-8bfd-294cda47310a admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.607535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94080110-74c9-47c2-8bfd-294cda47310a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.607810 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94080110-74c9-47c2-8bfd-294cda47310a admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.608499 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94080110-74c9-47c2-8bfd-294cda47310a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:54.610068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94080110-74c9-47c2-8bfd-294cda47310a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:54.623109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1209/2412] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:06:54.624090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94080110-74c9-47c2-8bfd-294cda47310a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:54.633821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94080110-74c9-47c2-8bfd-294cda47310a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:54.640020 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3688e-8da6-4ba2-b10b-9fdf2bc48ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:54.640722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3688e-8da6-4ba2-b10b-9fdf2bc48ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.641016 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3688e-8da6-4ba2-b10b-9fdf2bc48ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.641279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3688e-8da6-4ba2-b10b-9fdf2bc48ec4 admin admin] PATH_INFO: `/v3/projects/b008e6e7a95b4d20b854f3433a9a897b/users/ebb5eb87246544a382697b4c73344db9/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.643153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3688e-8da6-4ba2-b10b-9fdf2bc48ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b008e6e7a95b4d20b854f3433a9a897b, user_id=ebb5eb87246544a382697b4c73344db9, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:54.645915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3688e-8da6-4ba2-b10b-9fdf2bc48ec4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:54.656694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1210/2413] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:06:54 2022] PUT /identity/v3/projects/b008e6e7a95b4d20b854f3433a9a897b/users/ebb5eb87246544a382697b4c73344db9/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:06:54.658317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaccf99-d139-44f6-adb4-4af48d8d462a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:54.661984 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:54.727185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c9d6-2944-4944-8c9f-48bf39a52af3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.727396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c9d6-2944-4944-8c9f-48bf39a52af3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.727657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c9d6-2944-4944-8c9f-48bf39a52af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.730138 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98139a1-88f0-4cea-829e-b866ce83469f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:54.730815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98139a1-88f0-4cea-829e-b866ce83469f service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.731101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98139a1-88f0-4cea-829e-b866ce83469f service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.731372 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98139a1-88f0-4cea-829e-b866ce83469f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.760781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6aa6c9d6-2944-4944-8c9f-48bf39a52af3 None None] MFA Rules not processed for user `ebb5eb87246544a382697b4c73344db9`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:54.761989 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6aa6c9d6-2944-4944-8c9f-48bf39a52af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:54.792315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98139a1-88f0-4cea-829e-b866ce83469f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:54.793947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98139a1-88f0-4cea-829e-b866ce83469f service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:54.802406 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1204/2414] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:06:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 17:06:54.836660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1211/2415] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:06:54.848874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98139a1-88f0-4cea-829e-b866ce83469f service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:54.850564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d98139a1-88f0-4cea-829e-b866ce83469f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:54.914888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98139a1-88f0-4cea-829e-b866ce83469f service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:54.920200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f21928-908b-40fd-8f41-070306954ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:54.920865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f21928-908b-40fd-8f41-070306954ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:54.921141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f21928-908b-40fd-8f41-070306954ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:54.921413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f21928-908b-40fd-8f41-070306954ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:54.988894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f21928-908b-40fd-8f41-070306954ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:54.990221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f21928-908b-40fd-8f41-070306954ce4 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:54.999566 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1205/2416] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:55.435334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8fc10-efc4-481c-a702-7fe5e7f50174 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:55.435836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8fc10-efc4-481c-a702-7fe5e7f50174 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:55.435922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8fc10-efc4-481c-a702-7fe5e7f50174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:55.459342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-2fa8fc10-efc4-481c-a702-7fe5e7f50174 None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:55.460617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2fa8fc10-efc4-481c-a702-7fe5e7f50174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:55.469792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1212/2417] 10.222.0.81 () {58 vars in 967 bytes} [Thu Aug 18 17:06:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:55.485813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f21928-908b-40fd-8f41-070306954ce4 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:55.494999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:55.503076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f21928-908b-40fd-8f41-070306954ce4 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:55.509430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b07ee1-228e-4f5a-889d-a6e29e6e4577 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:55.510276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b07ee1-228e-4f5a-889d-a6e29e6e4577 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:55.510732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b07ee1-228e-4f5a-889d-a6e29e6e4577 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:55.511005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b07ee1-228e-4f5a-889d-a6e29e6e4577 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:55.523115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b07ee1-228e-4f5a-889d-a6e29e6e4577 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:55.526200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b07ee1-228e-4f5a-889d-a6e29e6e4577 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:55.538676 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1206/2418] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:06:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 17:06:55.858330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5473376-0a35-462f-bc88-cdb6a15d09fe None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:55.858651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5473376-0a35-462f-bc88-cdb6a15d09fe None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:55.858936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5473376-0a35-462f-bc88-cdb6a15d09fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:55.878704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e5473376-0a35-462f-bc88-cdb6a15d09fe None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:55.879942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e5473376-0a35-462f-bc88-cdb6a15d09fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:55.888039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1213/2419] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:06:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:55.901225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b07ee1-228e-4f5a-889d-a6e29e6e4577 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:55.912075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b07ee1-228e-4f5a-889d-a6e29e6e4577 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:55.917450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef205a9-b6bd-4927-a62d-bcb009369251 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:55.918074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef205a9-b6bd-4927-a62d-bcb009369251 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:55.918355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef205a9-b6bd-4927-a62d-bcb009369251 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:55.918642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef205a9-b6bd-4927-a62d-bcb009369251 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:55.928181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef205a9-b6bd-4927-a62d-bcb009369251 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:55.929837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef205a9-b6bd-4927-a62d-bcb009369251 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:55.938655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1207/2420] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:06:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:06:56.317607 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025a368-7b92-41e6-a9e0-050c94d3d739 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:56.317968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025a368-7b92-41e6-a9e0-050c94d3d739 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:56.318320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025a368-7b92-41e6-a9e0-050c94d3d739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:56.340676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c025a368-7b92-41e6-a9e0-050c94d3d739 None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:56.341924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c025a368-7b92-41e6-a9e0-050c94d3d739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:56.349854 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1214/2421] 10.222.0.81 () {58 vars in 967 bytes} [Thu Aug 18 17:06:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:56.363338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef205a9-b6bd-4927-a62d-bcb009369251 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:56.376805 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef205a9-b6bd-4927-a62d-bcb009369251 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:56.395001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37746191-d2f8-4008-a16a-32e460bd5db8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:56.395001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37746191-d2f8-4008-a16a-32e460bd5db8 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:56.395001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37746191-d2f8-4008-a16a-32e460bd5db8 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:56.395001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37746191-d2f8-4008-a16a-32e460bd5db8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:56.399074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37746191-d2f8-4008-a16a-32e460bd5db8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:56.401282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37746191-d2f8-4008-a16a-32e460bd5db8 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:56.425861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1208/2422] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:06:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:06:56.881114 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7385aa-2b84-4a00-9392-ecfe1a4009a2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:56.881560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7385aa-2b84-4a00-9392-ecfe1a4009a2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:56.881686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7385aa-2b84-4a00-9392-ecfe1a4009a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:56.889787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:57.028637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-dc7385aa-2b84-4a00-9392-ecfe1a4009a2 None None] MFA Rules not processed for user `7177f283d8304de19d19230ba2e61084`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:57.029860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-dc7385aa-2b84-4a00-9392-ecfe1a4009a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:57.096187 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1215/2423] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:57.665075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37746191-d2f8-4008-a16a-32e460bd5db8 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:57.761754 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37746191-d2f8-4008-a16a-32e460bd5db8 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:57.767406 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:57.768126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:57.768575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:57.769044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] PATH_INFO: `/v3/users/f20667e137f849d1ad1a1e21badd53f6` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:57.770250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20667e137f849d1ad1a1e21badd53f6)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:57.772442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:57.844817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20667e137f849d1ad1a1e21badd53f6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:57.857559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20667e137f849d1ad1a1e21badd53f6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:57.858437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20667e137f849d1ad1a1e21badd53f6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:57.861734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20667e137f849d1ad1a1e21badd53f6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:57.872421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20667e137f849d1ad1a1e21badd53f6'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:57.904193 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1209/2424] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:06:57 2022] DELETE /identity/v3/users/f20667e137f849d1ad1a1e21badd53f6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:57.908483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f781ad-2be3-4a35-9e7c-9c57c12d4ab7 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:57.909109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f781ad-2be3-4a35-9e7c-9c57c12d4ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:57.909109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f781ad-2be3-4a35-9e7c-9c57c12d4ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:57.940020 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e2f781ad-2be3-4a35-9e7c-9c57c12d4ab7 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:57.941290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e2f781ad-2be3-4a35-9e7c-9c57c12d4ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:58.011695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1216/2425] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:58.021218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:58.022631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:58.083464 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:58.104024 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699745b-8fb8-480b-9e7c-8fc277e7f473 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:58.107735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95836671-b82b-4366-b80e-70cacd312298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:58.108358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95836671-b82b-4366-b80e-70cacd312298 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:58.108668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95836671-b82b-4366-b80e-70cacd312298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:58.108946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95836671-b82b-4366-b80e-70cacd312298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:58.121290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95836671-b82b-4366-b80e-70cacd312298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:58.122723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95836671-b82b-4366-b80e-70cacd312298 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:58.134576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1210/2426] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:06:58.428720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f781ad-2be3-4a35-9e7c-9c57c12d4ab7 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:58.430365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e2f781ad-2be3-4a35-9e7c-9c57c12d4ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:58.456310 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f781ad-2be3-4a35-9e7c-9c57c12d4ab7 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:58.463005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:58.463400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:58.463872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:58.464150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] PATH_INFO: `/v3/projects/50d09fa179804c91abc0831c7d50dbc8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:58.465354 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d09fa179804c91abc0831c7d50dbc8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:58.467375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:58.532983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d09fa179804c91abc0831c7d50dbc8', 'request_id': 'req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.542132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d09fa179804c91abc0831c7d50dbc8', 'request_id': 'req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.549734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d09fa179804c91abc0831c7d50dbc8', 'request_id': 'req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.566548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] The token cache is being invalidate because project 50d09fa179804c91abc0831c7d50dbc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:06:58.566913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.567634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.569304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1217/2427] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:06:58 2022] DELETE /identity/v3/projects/50d09fa179804c91abc0831c7d50dbc8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:58.573947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95836671-b82b-4366-b80e-70cacd312298 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:58.584631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95836671-b82b-4366-b80e-70cacd312298 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:58.658337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:58.658973 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:58.659259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:58.659534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] PATH_INFO: `/v3/users/ebb5eb87246544a382697b4c73344db9` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:58.660678 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb5eb87246544a382697b4c73344db9)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:58.662577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:58.717103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:58.717682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb5eb87246544a382697b4c73344db9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.718714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:58.731214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb5eb87246544a382697b4c73344db9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.731937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb5eb87246544a382697b4c73344db9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.732657 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb5eb87246544a382697b4c73344db9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.738067 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf65e9-7c21-40a8-a4c4-c5f2f9da7bd9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:58.740551 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-8353fa17-c07e-426b-b0df-b5c7a698187d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb5eb87246544a382697b4c73344db9'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.743304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:58.743951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:58.744230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:58.744563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] PATH_INFO: `/v3/users/b797c6fe192c482199a2a474d2fe84a8` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:58.745701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b797c6fe192c482199a2a474d2fe84a8)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:58.747685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:58.758213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1211/2428] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:06:58 2022] DELETE /identity/v3/users/ebb5eb87246544a382697b4c73344db9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:58.777183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:58.804275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b797c6fe192c482199a2a474d2fe84a8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.804986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b797c6fe192c482199a2a474d2fe84a8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.817596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b797c6fe192c482199a2a474d2fe84a8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.824939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b797c6fe192c482199a2a474d2fe84a8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.825747 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b797c6fe192c482199a2a474d2fe84a8'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:58.840625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1218/2429] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:06:58 2022] DELETE /identity/v3/users/b797c6fe192c482199a2a474d2fe84a8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:06:58.845206 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaf6b4-68a1-43a6-b7c1-24e2ef4cb6c3 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:58.845576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaf6b4-68a1-43a6-b7c1-24e2ef4cb6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:58.845986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaf6b4-68a1-43a6-b7c1-24e2ef4cb6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:58.866065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-58eaf6b4-68a1-43a6-b7c1-24e2ef4cb6c3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:58.867269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-58eaf6b4-68a1-43a6-b7c1-24e2ef4cb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:58.943784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1212/2430] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:58.951833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:58.953412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:59.044647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e34c6b-9031-4c8d-a1ae-41f85d27c78d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:59.049262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0eb1a-7a52-4cfd-be27-a34df5a274e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:59.050154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0eb1a-7a52-4cfd-be27-a34df5a274e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.050435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0eb1a-7a52-4cfd-be27-a34df5a274e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.050710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0eb1a-7a52-4cfd-be27-a34df5a274e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:59.063357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0eb1a-7a52-4cfd-be27-a34df5a274e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:59.065951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0eb1a-7a52-4cfd-be27-a34df5a274e8 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:59.081678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1219/2431] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:06:59.137636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaf6b4-68a1-43a6-b7c1-24e2ef4cb6c3 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:59.139163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-58eaf6b4-68a1-43a6-b7c1-24e2ef4cb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:59.166553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:59.172045 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaf6b4-68a1-43a6-b7c1-24e2ef4cb6c3 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:59.211907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:59.212541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.212839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.213151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] PATH_INFO: `/v3/projects/b008e6e7a95b4d20b854f3433a9a897b` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:59.214738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b008e6e7a95b4d20b854f3433a9a897b)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:59.216961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:59.323963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b008e6e7a95b4d20b854f3433a9a897b', 'request_id': 'req-5d97fd9f-e615-40d9-aa7b-817df82f2274'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:59.333574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b008e6e7a95b4d20b854f3433a9a897b', 'request_id': 'req-5d97fd9f-e615-40d9-aa7b-817df82f2274'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:59.345861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b008e6e7a95b4d20b854f3433a9a897b', 'request_id': 'req-5d97fd9f-e615-40d9-aa7b-817df82f2274'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:59.365854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] The token cache is being invalidate because project b008e6e7a95b4d20b854f3433a9a897b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:06:59.366350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:59.367070 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:59.372939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1213/2432] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:06:59 2022] DELETE /identity/v3/projects/b008e6e7a95b4d20b854f3433a9a897b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:06:59.374131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ba874-4e74-44bf-bc2d-befcbb398672 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.374430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ba874-4e74-44bf-bc2d-befcbb398672 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.374714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ba874-4e74-44bf-bc2d-befcbb398672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:59.403889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e60ba874-4e74-44bf-bc2d-befcbb398672 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:59.405295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e60ba874-4e74-44bf-bc2d-befcbb398672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:59.458567 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:59.460139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:59.515328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1220/2433] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:59.523483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3e521-220d-470d-bb18-bc7544e06d7f None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.524715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3e521-220d-470d-bb18-bc7544e06d7f None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.527269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3e521-220d-470d-bb18-bc7544e06d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:59.551580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97fd9f-e615-40d9-aa7b-817df82f2274 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:59.553049 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-30a3e521-220d-470d-bb18-bc7544e06d7f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:06:59.554337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-30a3e521-220d-470d-bb18-bc7544e06d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:59.557031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:59.557685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.557987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.558248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] PATH_INFO: `/v3/projects/62c9d0a785d54f3f85240f09bf163302` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:59.559992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c9d0a785d54f3f85240f09bf163302)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:59.562181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:59.566620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1221/2434] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:06:59.570529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3e521-220d-470d-bb18-bc7544e06d7f None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:59.580502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3e521-220d-470d-bb18-bc7544e06d7f None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:59.585737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888d8e7-3c53-4bf1-831c-775796c93f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:59.586384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888d8e7-3c53-4bf1-831c-775796c93f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.586665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888d8e7-3c53-4bf1-831c-775796c93f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.587008 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888d8e7-3c53-4bf1-831c-775796c93f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:59.587856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888d8e7-3c53-4bf1-831c-775796c93f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:06:59.588021 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888d8e7-3c53-4bf1-831c-775796c93f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:59.589720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888d8e7-3c53-4bf1-831c-775796c93f53 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:59.605395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1222/2435] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 17:06:59.608630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888d8e7-3c53-4bf1-831c-775796c93f53 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:59.619808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888d8e7-3c53-4bf1-831c-775796c93f53 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:59.630255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c9d0a785d54f3f85240f09bf163302', 'request_id': 'req-e085cb6f-cc16-43e4-9340-e0ff22eb8424'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:59.638723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c9d0a785d54f3f85240f09bf163302', 'request_id': 'req-e085cb6f-cc16-43e4-9340-e0ff22eb8424'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:59.650161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c9d0a785d54f3f85240f09bf163302', 'request_id': 'req-e085cb6f-cc16-43e4-9340-e0ff22eb8424'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:59.662722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] The token cache is being invalidate because project 62c9d0a785d54f3f85240f09bf163302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:06:59.662722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:59.663647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:06:59.664365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:59.668561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1214/2436] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:06:59 2022] DELETE /identity/v3/projects/62c9d0a785d54f3f85240f09bf163302 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:06:59.724806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e110-0b66-4ced-98aa-8fa22ccc73e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:59.725450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e110-0b66-4ced-98aa-8fa22ccc73e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.726635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e110-0b66-4ced-98aa-8fa22ccc73e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.726997 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e110-0b66-4ced-98aa-8fa22ccc73e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:59.727939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686e110-0b66-4ced-98aa-8fa22ccc73e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:59.731051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686e110-0b66-4ced-98aa-8fa22ccc73e5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:59.767512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1223/2437] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:06:59 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:06:59.770597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:59.773019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:06:59.787836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085cb6f-cc16-43e4-9340-e0ff22eb8424 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:59.802719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:59.877227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cae2e8-8aea-402a-96fc-7dc8d6dfef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:59.877844 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cae2e8-8aea-402a-96fc-7dc8d6dfef2b admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.878124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cae2e8-8aea-402a-96fc-7dc8d6dfef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.879183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cae2e8-8aea-402a-96fc-7dc8d6dfef2b admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:59.879817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cae2e8-8aea-402a-96fc-7dc8d6dfef2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:59.881825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cae2e8-8aea-402a-96fc-7dc8d6dfef2b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:59.907819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1215/2438] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:06:59 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:06:59.909002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e110-0b66-4ced-98aa-8fa22ccc73e5 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:59.919525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e110-0b66-4ced-98aa-8fa22ccc73e5 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:59.924843 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd817f-1b6e-4c9c-8668-ac1fcb4bfea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:59.925458 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd817f-1b6e-4c9c-8668-ac1fcb4bfea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.925746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd817f-1b6e-4c9c-8668-ac1fcb4bfea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.926015 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd817f-1b6e-4c9c-8668-ac1fcb4bfea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:59.926732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd817f-1b6e-4c9c-8668-ac1fcb4bfea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:59.928345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd817f-1b6e-4c9c-8668-ac1fcb4bfea1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:59.940271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1224/2439] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:06:59.944308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cae2e8-8aea-402a-96fc-7dc8d6dfef2b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:59.954989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cae2e8-8aea-402a-96fc-7dc8d6dfef2b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:59.959642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a308d09-2f6f-46ec-97ee-1759c7fe9f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:59.960243 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a308d09-2f6f-46ec-97ee-1759c7fe9f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.960559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a308d09-2f6f-46ec-97ee-1759c7fe9f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.960839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a308d09-2f6f-46ec-97ee-1759c7fe9f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:06:59.961527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a308d09-2f6f-46ec-97ee-1759c7fe9f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:06:59.963709 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a308d09-2f6f-46ec-97ee-1759c7fe9f98 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:06:59.977216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1216/2440] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:06:59.982202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd817f-1b6e-4c9c-8668-ac1fcb4bfea1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:06:59.992730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd817f-1b6e-4c9c-8668-ac1fcb4bfea1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:06:59.998159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4db4f4-3a68-4ac0-8853-15f82532e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:06:59.998818 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4db4f4-3a68-4ac0-8853-15f82532e6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:06:59.999100 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4db4f4-3a68-4ac0-8853-15f82532e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:06:59.999382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4db4f4-3a68-4ac0-8853-15f82532e6c4 admin admin] PATH_INFO: `/v3/projects/cb0ea20b875e459cb425e13abb2d71fc/users/a3c8743e0647496b9c8765940673a216/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:00.015247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4db4f4-3a68-4ac0-8853-15f82532e6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0ea20b875e459cb425e13abb2d71fc, user_id=a3c8743e0647496b9c8765940673a216, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:00.018032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4db4f4-3a68-4ac0-8853-15f82532e6c4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:00.034659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1225/2441] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:06:59 2022] PUT /identity/v3/projects/cb0ea20b875e459cb425e13abb2d71fc/users/a3c8743e0647496b9c8765940673a216/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:07:00.046964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6189-748a-47a5-a023-2b2e01bfbcfa None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:00.047328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6189-748a-47a5-a023-2b2e01bfbcfa None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:00.051076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6189-748a-47a5-a023-2b2e01bfbcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:00.097618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-170d6189-748a-47a5-a023-2b2e01bfbcfa None None] MFA Rules not processed for user `a3c8743e0647496b9c8765940673a216`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:07:00.098956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-170d6189-748a-47a5-a023-2b2e01bfbcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:00.176951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1217/2442] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:07:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:07:00.189002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4db4f4-3a68-4ac0-8853-15f82532e6c4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:07:00.190800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-be4db4f4-3a68-4ac0-8853-15f82532e6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:00.258461 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4db4f4-3a68-4ac0-8853-15f82532e6c4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:07:00.262710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c8862-543e-4c8d-8748-2f3b52a7329a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:07:00.263339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8862-543e-4c8d-8748-2f3b52a7329a service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:00.263623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8862-543e-4c8d-8748-2f3b52a7329a service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:00.263883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c8862-543e-4c8d-8748-2f3b52a7329a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:00.273955 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c8862-543e-4c8d-8748-2f3b52a7329a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:00.275968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c8862-543e-4c8d-8748-2f3b52a7329a service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:00.293343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1226/2443] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:07:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:07:03.408495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d6189-748a-47a5-a023-2b2e01bfbcfa None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:07:03.469792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d6189-748a-47a5-a023-2b2e01bfbcfa None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:07:03.474564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:07:03.475196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:03.475478 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:03.475752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] PATH_INFO: `/v3/users/a3c8743e0647496b9c8765940673a216` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:03.476899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c8743e0647496b9c8765940673a216)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:03.479324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:03.508171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:03.526424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c8743e0647496b9c8765940673a216'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:07:03.533323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c8743e0647496b9c8765940673a216'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:07:03.533927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c8743e0647496b9c8765940673a216'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:07:03.534529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c8743e0647496b9c8765940673a216'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:07:03.541943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c8743e0647496b9c8765940673a216'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:07:03.559704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1218/2444] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:07:03 2022] DELETE /identity/v3/users/a3c8743e0647496b9c8765940673a216 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:07:03.564332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdd8dc-f1fa-4f2f-aa76-dc12449e3a26 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:03.564880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdd8dc-f1fa-4f2f-aa76-dc12449e3a26 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:03.564880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdd8dc-f1fa-4f2f-aa76-dc12449e3a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:03.583892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-1ccdd8dc-f1fa-4f2f-aa76-dc12449e3a26 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:07:03.585132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1ccdd8dc-f1fa-4f2f-aa76-dc12449e3a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:03.643656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1227/2445] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:07:03.653985 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:07:03.655432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:03.712758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f19bd9-9658-4019-9346-f5ab94d5a062 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:07:03.716391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dd106-7b96-41a7-96b2-5b341b788ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:07:03.717024 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd106-7b96-41a7-96b2-5b341b788ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:03.717298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd106-7b96-41a7-96b2-5b341b788ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:03.717569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd106-7b96-41a7-96b2-5b341b788ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:03.727226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dd106-7b96-41a7-96b2-5b341b788ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:03.728796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dd106-7b96-41a7-96b2-5b341b788ac5 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:03.738283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1219/2446] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:07:04.015758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdd8dc-f1fa-4f2f-aa76-dc12449e3a26 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:07:04.017568 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1ccdd8dc-f1fa-4f2f-aa76-dc12449e3a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:04.031475 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdd8dc-f1fa-4f2f-aa76-dc12449e3a26 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:07:04.037042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:07:04.037785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:04.038129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:04.038480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] PATH_INFO: `/v3/projects/cb0ea20b875e459cb425e13abb2d71fc` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:04.039751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0ea20b875e459cb425e13abb2d71fc)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:04.042385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:04.061135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:04.096554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0ea20b875e459cb425e13abb2d71fc', 'request_id': 'req-6eff2b00-e7ff-481c-9681-c20da0a91d1c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:07:04.105450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0ea20b875e459cb425e13abb2d71fc', 'request_id': 'req-6eff2b00-e7ff-481c-9681-c20da0a91d1c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:07:04.112104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0ea20b875e459cb425e13abb2d71fc', 'request_id': 'req-6eff2b00-e7ff-481c-9681-c20da0a91d1c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:07:04.123432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] The token cache is being invalidate because project cb0ea20b875e459cb425e13abb2d71fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:07:04.123678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:07:04.124273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-6eff2b00-e7ff-481c-9681-c20da0a91d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:07:04.126019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1228/2447] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:07:04 2022] DELETE /identity/v3/projects/cb0ea20b875e459cb425e13abb2d71fc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:07:09.658026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dd106-7b96-41a7-96b2-5b341b788ac5 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:07:09.659431 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-8e3dd106-7b96-41a7-96b2-5b341b788ac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:09.730557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dd106-7b96-41a7-96b2-5b341b788ac5 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:07:09.778351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:09.794089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1942867-50b8-443c-98f3-7b9e47d7fdc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:07:09.794746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942867-50b8-443c-98f3-7b9e47d7fdc1 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:09.795158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942867-50b8-443c-98f3-7b9e47d7fdc1 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:09.795441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1942867-50b8-443c-98f3-7b9e47d7fdc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:09.797363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d1942867-50b8-443c-98f3-7b9e47d7fdc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:09.809781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1942867-50b8-443c-98f3-7b9e47d7fdc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:09.811386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1942867-50b8-443c-98f3-7b9e47d7fdc1 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:09.822340 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1220/2448] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:07:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:07:14.120305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:19.817321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=9 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:25.419409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df09958-4bd6-4e91-8099-28ef6fd301bc None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:25.419967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df09958-4bd6-4e91-8099-28ef6fd301bc None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:25.419967 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df09958-4bd6-4e91-8099-28ef6fd301bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:25.438778 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3df09958-4bd6-4e91-8099-28ef6fd301bc None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:07:25.439990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3df09958-4bd6-4e91-8099-28ef6fd301bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:25.497988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1229/2449] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:07:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:07:25.510692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1942867-50b8-443c-98f3-7b9e47d7fdc1 service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:07:25.512110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d1942867-50b8-443c-98f3-7b9e47d7fdc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:25.583133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1942867-50b8-443c-98f3-7b9e47d7fdc1 service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:07:25.588197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95c00a-79cf-45e5-b2bf-806d64e2a340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:07:25.589386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c00a-79cf-45e5-b2bf-806d64e2a340 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:25.589386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c00a-79cf-45e5-b2bf-806d64e2a340 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:25.589386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c00a-79cf-45e5-b2bf-806d64e2a340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:25.598165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95c00a-79cf-45e5-b2bf-806d64e2a340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:25.599924 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95c00a-79cf-45e5-b2bf-806d64e2a340 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:25.612250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1221/2450] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:07:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:07:35.489976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=25 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:35.608498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=32 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:42.113225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f7918-1ff5-4108-b43c-77c3af2882fe None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:42.114235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f7918-1ff5-4108-b43c-77c3af2882fe None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:42.114754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f7918-1ff5-4108-b43c-77c3af2882fe None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:42.116612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1230/2451] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:07:42.125419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232384fd-96bd-44db-a838-84a855b865bf None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:42.126032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232384fd-96bd-44db-a838-84a855b865bf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:42.126136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232384fd-96bd-44db-a838-84a855b865bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:42.151794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-232384fd-96bd-44db-a838-84a855b865bf None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:07:42.153570 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-232384fd-96bd-44db-a838-84a855b865bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:42.241292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1222/2452] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:07:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:07:42.253744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f7918-1ff5-4108-b43c-77c3af2882fe None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:07:42.255446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8e0f7918-1ff5-4108-b43c-77c3af2882fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:42.313073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f7918-1ff5-4108-b43c-77c3af2882fe None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:07:42.316553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbecc1-c218-4ceb-a922-87ef7ff2f711 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a710cfeadd004a8bbf932f6bb3b211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:07:42.317193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbecc1-c218-4ceb-a922-87ef7ff2f711 service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:42.317480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbecc1-c218-4ceb-a922-87ef7ff2f711 service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:42.317755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbecc1-c218-4ceb-a922-87ef7ff2f711 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:42.328648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbecc1-c218-4ceb-a922-87ef7ff2f711 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:42.330076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbecc1-c218-4ceb-a922-87ef7ff2f711 service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:42.341012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1231/2453] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:07:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:07:42.409323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5dc1-da17-4a28-94b7-5ee3ea8b94c4 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:42.409589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5dc1-da17-4a28-94b7-5ee3ea8b94c4 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:42.409864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5dc1-da17-4a28-94b7-5ee3ea8b94c4 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:42.411236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1223/2454] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:07:42.416603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7b67-e13c-4b19-971c-7b261423ae56 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:42.416887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7b67-e13c-4b19-971c-7b261423ae56 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:42.417159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7b67-e13c-4b19-971c-7b261423ae56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:42.436712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-ab7f7b67-e13c-4b19-971c-7b261423ae56 None None] MFA Rules not processed for user `7b1fde904acd460899d8c736f5762056`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:07:42.437898 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ab7f7b67-e13c-4b19-971c-7b261423ae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:42.488926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1232/2455] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:07:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:07:42.501587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5dc1-da17-4a28-94b7-5ee3ea8b94c4 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:07:42.503465 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c4fd5dc1-da17-4a28-94b7-5ee3ea8b94c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:42.516584 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5dc1-da17-4a28-94b7-5ee3ea8b94c4 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:07:42.520373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c6998-cce1-4447-86c6-be00cdcbc401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:07:42.521006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6998-cce1-4447-86c6-be00cdcbc401 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:42.521288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6998-cce1-4447-86c6-be00cdcbc401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:42.521575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6998-cce1-4447-86c6-be00cdcbc401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:42.528861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c6998-cce1-4447-86c6-be00cdcbc401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:42.530309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c6998-cce1-4447-86c6-be00cdcbc401 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:42.537925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1224/2456] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:07:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:07:42.622341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1782d5a-ed22-4c5e-a14f-b12ab9d724db None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:42.622624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1782d5a-ed22-4c5e-a14f-b12ab9d724db None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:42.622901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1782d5a-ed22-4c5e-a14f-b12ab9d724db None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:42.624278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1233/2457] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:07:42.629312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101f22-3d1e-4c11-a89b-6f48b7815c7f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:42.629598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101f22-3d1e-4c11-a89b-6f48b7815c7f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:42.629875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101f22-3d1e-4c11-a89b-6f48b7815c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:42.650873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a2101f22-3d1e-4c11-a89b-6f48b7815c7f None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:07:42.652223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a2101f22-3d1e-4c11-a89b-6f48b7815c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:42.663230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1225/2458] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:07:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:07:42.674323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1782d5a-ed22-4c5e-a14f-b12ab9d724db None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:07:42.686926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1782d5a-ed22-4c5e-a14f-b12ab9d724db None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:07:42.690543 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd2d5f-bd00-47c5-a945-23d3bcf15ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:07:42.691141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd2d5f-bd00-47c5-a945-23d3bcf15ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:42.691423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd2d5f-bd00-47c5-a945-23d3bcf15ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:42.691699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd2d5f-bd00-47c5-a945-23d3bcf15ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:42.702537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd2d5f-bd00-47c5-a945-23d3bcf15ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:42.703996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd2d5f-bd00-47c5-a945-23d3bcf15ae2 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:42.715401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1234/2459] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:07:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:07:44.718086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3604-44a9-4d61-9226-f527b22f9a72 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:44.718568 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3604-44a9-4d61-9226-f527b22f9a72 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:44.718670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3604-44a9-4d61-9226-f527b22f9a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:44.739133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f97d3604-44a9-4d61-9226-f527b22f9a72 None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:07:44.740336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f97d3604-44a9-4d61-9226-f527b22f9a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:07:44.747610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1226/2460] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:07:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:07:44.759876 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd2d5f-bd00-47c5-a945-23d3bcf15ae2 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:07:44.770868 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd2d5f-bd00-47c5-a945-23d3bcf15ae2 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:07:44.776733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924094-8ee5-4639-bd48-94e2808a2b37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:07:44.777367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924094-8ee5-4639-bd48-94e2808a2b37 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:07:44.777632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924094-8ee5-4639-bd48-94e2808a2b37 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:07:44.777907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924094-8ee5-4639-bd48-94e2808a2b37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:07:44.786135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07924094-8ee5-4639-bd48-94e2808a2b37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:07:44.787696 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07924094-8ee5-4639-bd48-94e2808a2b37 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:07:44.797373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1235/2461] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:07:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:07:54.734167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=43 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:54.792546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=61 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:11.106727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b81d-c01c-495b-99c1-0884f56e6c50 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:08:11.107289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b81d-c01c-495b-99c1-0884f56e6c50 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:08:11.107289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b81d-c01c-495b-99c1-0884f56e6c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:08:11.126934 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-3984b81d-c01c-495b-99c1-0884f56e6c50 None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:08:11.128120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3984b81d-c01c-495b-99c1-0884f56e6c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:08:11.135194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1227/2462] 10.222.0.81 () {58 vars in 967 bytes} [Thu Aug 18 17:08:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:08:11.157275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924094-8ee5-4639-bd48-94e2808a2b37 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:08:11.168489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924094-8ee5-4639-bd48-94e2808a2b37 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:08:11.173650 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f884b52-7803-4188-8e52-ca297c46c421 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:08:11.174251 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f884b52-7803-4188-8e52-ca297c46c421 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:08:11.174536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f884b52-7803-4188-8e52-ca297c46c421 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:08:11.174815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f884b52-7803-4188-8e52-ca297c46c421 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:08:11.182764 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f884b52-7803-4188-8e52-ca297c46c421 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:08:11.184334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f884b52-7803-4188-8e52-ca297c46c421 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:08:11.192438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1236/2463] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:08:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:08:21.122430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:21.189186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:03.400156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984b81d-c01c-495b-99c1-0884f56e6c50 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:09:03.401575 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3984b81d-c01c-495b-99c1-0884f56e6c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:03.413455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984b81d-c01c-495b-99c1-0884f56e6c50 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:09:03.417049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5a941-cfed-4992-8754-9add5369a008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:09:03.417653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a941-cfed-4992-8754-9add5369a008 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:03.417929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a941-cfed-4992-8754-9add5369a008 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:03.418202 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a941-cfed-4992-8754-9add5369a008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:03.419966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d1d5a941-cfed-4992-8754-9add5369a008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:03.434397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5a941-cfed-4992-8754-9add5369a008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:09:03.435834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5a941-cfed-4992-8754-9add5369a008 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:09:03.447263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1228/2464] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:09:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:09:04.882707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f884b52-7803-4188-8e52-ca297c46c421 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:09:04.892720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f884b52-7803-4188-8e52-ca297c46c421 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:09:04.896249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae368cef-3542-4fcc-b8a8-940378ffe40e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:09:04.896882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae368cef-3542-4fcc-b8a8-940378ffe40e service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:04.897164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae368cef-3542-4fcc-b8a8-940378ffe40e service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:04.897429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae368cef-3542-4fcc-b8a8-940378ffe40e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:04.899363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ae368cef-3542-4fcc-b8a8-940378ffe40e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:04.912473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae368cef-3542-4fcc-b8a8-940378ffe40e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:09:04.913924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae368cef-3542-4fcc-b8a8-940378ffe40e service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:09:04.925046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1237/2465] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:09:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:09:13.441789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:14.920165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=6 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:31.787103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5a941-cfed-4992-8754-9add5369a008 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:09:31.796293 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5a941-cfed-4992-8754-9add5369a008 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:09:31.801074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff7350-dce1-4dd9-a97b-41195a550756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:09:31.801684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff7350-dce1-4dd9-a97b-41195a550756 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:31.802273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff7350-dce1-4dd9-a97b-41195a550756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:31.802273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff7350-dce1-4dd9-a97b-41195a550756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:31.804315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-09ff7350-dce1-4dd9-a97b-41195a550756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:31.814841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff7350-dce1-4dd9-a97b-41195a550756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:09:31.816243 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff7350-dce1-4dd9-a97b-41195a550756 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:09:31.824385 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1229/2466] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:09:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:09:32.521123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae368cef-3542-4fcc-b8a8-940378ffe40e service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:09:32.522558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ae368cef-3542-4fcc-b8a8-940378ffe40e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:32.536125 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae368cef-3542-4fcc-b8a8-940378ffe40e service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:09:32.541628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341103e-6081-4be5-90a1-87ef9fcda8aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:09:32.542225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341103e-6081-4be5-90a1-87ef9fcda8aa service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:32.542500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341103e-6081-4be5-90a1-87ef9fcda8aa service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:32.542774 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341103e-6081-4be5-90a1-87ef9fcda8aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:32.544432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a341103e-6081-4be5-90a1-87ef9fcda8aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:32.603149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341103e-6081-4be5-90a1-87ef9fcda8aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:09:32.604653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341103e-6081-4be5-90a1-87ef9fcda8aa service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:09:32.613514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1238/2467] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:09:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:09:34.848416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371087-7599-48a2-8065-0566e8f62d11 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:34.849020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371087-7599-48a2-8065-0566e8f62d11 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:34.849020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06371087-7599-48a2-8065-0566e8f62d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:34.868229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-06371087-7599-48a2-8065-0566e8f62d11 None None] MFA Rules not processed for user `7177f283d8304de19d19230ba2e61084`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:09:34.869467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-06371087-7599-48a2-8065-0566e8f62d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:34.931123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1230/2468] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:09:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:09:38.292665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341103e-6081-4be5-90a1-87ef9fcda8aa service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:09:38.304907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341103e-6081-4be5-90a1-87ef9fcda8aa service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:09:38.311188 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a44a80-b0a7-4500-89d4-a94c48031f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:09:38.311822 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a44a80-b0a7-4500-89d4-a94c48031f20 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:38.312356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a44a80-b0a7-4500-89d4-a94c48031f20 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:38.312672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a44a80-b0a7-4500-89d4-a94c48031f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:38.314472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d5a44a80-b0a7-4500-89d4-a94c48031f20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:38.328074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a44a80-b0a7-4500-89d4-a94c48031f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:09:38.329762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a44a80-b0a7-4500-89d4-a94c48031f20 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:09:38.342222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1239/2469] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:09:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:09:42.569441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06371087-7599-48a2-8065-0566e8f62d11 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:09:42.595806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06371087-7599-48a2-8065-0566e8f62d11 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:09:42.603095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0f876-1f94-434b-a2f2-b939a1cfd05c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:09:42.603972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0f876-1f94-434b-a2f2-b939a1cfd05c service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:42.604362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0f876-1f94-434b-a2f2-b939a1cfd05c service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:42.605375 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0f876-1f94-434b-a2f2-b939a1cfd05c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:42.607338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3fe0f876-1f94-434b-a2f2-b939a1cfd05c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:42.625410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0f876-1f94-434b-a2f2-b939a1cfd05c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:09:42.627180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0f876-1f94-434b-a2f2-b939a1cfd05c service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:09:42.640008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1231/2470] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:09:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:09:43.801046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500995-37e2-450d-99bf-06538bf157c1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:43.801616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500995-37e2-450d-99bf-06538bf157c1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:43.801616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500995-37e2-450d-99bf-06538bf157c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:43.823395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0d500995-37e2-450d-99bf-06538bf157c1 None None] MFA Rules not processed for user `53327160ebb04585b414ad1571259834`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:09:43.825748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0d500995-37e2-450d-99bf-06538bf157c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:43.833014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1240/2471] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:09:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:09:44.142393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0f876-1f94-434b-a2f2-b939a1cfd05c service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:09:44.152392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0f876-1f94-434b-a2f2-b939a1cfd05c service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:09:44.156015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365239a-014e-4254-a257-ef7016b53eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:09:44.156649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365239a-014e-4254-a257-ef7016b53eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:44.156930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365239a-014e-4254-a257-ef7016b53eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:44.157207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365239a-014e-4254-a257-ef7016b53eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:44.158994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b365239a-014e-4254-a257-ef7016b53eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:44.169100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365239a-014e-4254-a257-ef7016b53eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:09:44.170517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365239a-014e-4254-a257-ef7016b53eb5 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:09:44.178384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1232/2472] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:09:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:09:44.493193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d500995-37e2-450d-99bf-06538bf157c1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:09:44.494707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0d500995-37e2-450d-99bf-06538bf157c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:44.509720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d500995-37e2-450d-99bf-06538bf157c1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:09:44.514702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03584f-ae0d-4a06-897a-d07b001b4f52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:09:44.515342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03584f-ae0d-4a06-897a-d07b001b4f52 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:44.515632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03584f-ae0d-4a06-897a-d07b001b4f52 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:44.515892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03584f-ae0d-4a06-897a-d07b001b4f52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:44.517678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-aa03584f-ae0d-4a06-897a-d07b001b4f52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:44.530771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03584f-ae0d-4a06-897a-d07b001b4f52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:09:44.532397 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03584f-ae0d-4a06-897a-d07b001b4f52 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:09:44.543607 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1241/2473] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:09:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:09:54.174883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=43 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:54.538544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=43 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:54.893222 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365239a-014e-4254-a257-ef7016b53eb5 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:09:54.895369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b365239a-014e-4254-a257-ef7016b53eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:54.912849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365239a-014e-4254-a257-ef7016b53eb5 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:09:54.918866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a6274-c031-4e4b-94b5-508766885b3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:09:54.919488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6274-c031-4e4b-94b5-508766885b3e service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:09:54.919772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6274-c031-4e4b-94b5-508766885b3e service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:09:54.920050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a6274-c031-4e4b-94b5-508766885b3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:09:54.921890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-986a6274-c031-4e4b-94b5-508766885b3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:09:54.935321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a6274-c031-4e4b-94b5-508766885b3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:09:54.936960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a6274-c031-4e4b-94b5-508766885b3e service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:09:54.949117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1233/2474] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:09:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:10:04.944837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:17.884165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03584f-ae0d-4a06-897a-d07b001b4f52 service placement] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:10:17.885744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-aa03584f-ae0d-4a06-897a-d07b001b4f52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:17.944093 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03584f-ae0d-4a06-897a-d07b001b4f52 service placement] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:10:17.947691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6061431-95c9-469c-a64e-6e31ae709be0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:10:17.948299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6061431-95c9-469c-a64e-6e31ae709be0 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:17.948613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6061431-95c9-469c-a64e-6e31ae709be0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:17.948890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6061431-95c9-469c-a64e-6e31ae709be0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:17.950585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b6061431-95c9-469c-a64e-6e31ae709be0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:18.013368 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6061431-95c9-469c-a64e-6e31ae709be0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:10:18.014737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6061431-95c9-469c-a64e-6e31ae709be0 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:10:18.024699 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1242/2475] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:10:23.036623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddf1fa-fd44-471c-b399-952b7895e16f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:23.037394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddf1fa-fd44-471c-b399-952b7895e16f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:23.037553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddf1fa-fd44-471c-b399-952b7895e16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:23.059510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bdddf1fa-fd44-471c-b399-952b7895e16f None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:10:23.060746 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bdddf1fa-fd44-471c-b399-952b7895e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:23.070464 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1234/2476] 10.222.0.81 () {58 vars in 967 bytes} [Thu Aug 18 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:10:23.122973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6061431-95c9-469c-a64e-6e31ae709be0 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:10:23.156263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6061431-95c9-469c-a64e-6e31ae709be0 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:10:23.165340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d164b0d-2bb0-4b15-974a-14a652ebacc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:10:23.166105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d164b0d-2bb0-4b15-974a-14a652ebacc6 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:23.166600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d164b0d-2bb0-4b15-974a-14a652ebacc6 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:23.166943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d164b0d-2bb0-4b15-974a-14a652ebacc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:23.176058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d164b0d-2bb0-4b15-974a-14a652ebacc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:10:23.177797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d164b0d-2bb0-4b15-974a-14a652ebacc6 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:10:23.187728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1243/2477] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:10:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:10:26.639273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddf1fa-fd44-471c-b399-952b7895e16f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:10:26.648911 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddf1fa-fd44-471c-b399-952b7895e16f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:10:26.652546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382317f-266c-4e12-9f1e-362d70f113d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:10:26.653157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382317f-266c-4e12-9f1e-362d70f113d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:26.653437 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382317f-266c-4e12-9f1e-362d70f113d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:26.653711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382317f-266c-4e12-9f1e-362d70f113d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:26.655693 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-3382317f-266c-4e12-9f1e-362d70f113d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:26.727901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382317f-266c-4e12-9f1e-362d70f113d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:10:26.729330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382317f-266c-4e12-9f1e-362d70f113d3 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:10:26.746856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1235/2478] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:10:26.914767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafcb9f-5947-4b02-a2fa-45efb6309ec5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:26.915813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafcb9f-5947-4b02-a2fa-45efb6309ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:26.915813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafcb9f-5947-4b02-a2fa-45efb6309ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:26.934897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-8fafcb9f-5947-4b02-a2fa-45efb6309ec5 None None] MFA Rules not processed for user `368cddc3968c4c39b7ca05c500872b45`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:10:26.936112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8fafcb9f-5947-4b02-a2fa-45efb6309ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:26.943119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1244/2479] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:10:27.754194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382317f-266c-4e12-9f1e-362d70f113d3 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:10:27.778367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382317f-266c-4e12-9f1e-362d70f113d3 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:10:27.789727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6ef51-ab7a-4696-9666-826fca10045c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:10:27.791011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6ef51-ab7a-4696-9666-826fca10045c service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:27.791355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6ef51-ab7a-4696-9666-826fca10045c service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:27.791730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6ef51-ab7a-4696-9666-826fca10045c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:27.793659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-06c6ef51-ab7a-4696-9666-826fca10045c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:27.808890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6ef51-ab7a-4696-9666-826fca10045c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:10:27.811021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6ef51-ab7a-4696-9666-826fca10045c service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:10:27.830925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1236/2480] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:10:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:10:31.410233 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafcb9f-5947-4b02-a2fa-45efb6309ec5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:10:31.411687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-8fafcb9f-5947-4b02-a2fa-45efb6309ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:31.444687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafcb9f-5947-4b02-a2fa-45efb6309ec5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:10:31.452188 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:10:31.453180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:31.453573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:31.453954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] PATH_INFO: `/v3/users/14a354aa586d44ad803850134bb9ec18` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:31.455345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a354aa586d44ad803850134bb9ec18)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:10:31.457367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:10:31.514350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a354aa586d44ad803850134bb9ec18'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:31.515052 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a354aa586d44ad803850134bb9ec18'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:31.528173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a354aa586d44ad803850134bb9ec18'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:31.535386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a354aa586d44ad803850134bb9ec18'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:31.536111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a354aa586d44ad803850134bb9ec18'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:31.549180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1245/2481] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:10:31 2022] DELETE /identity/v3/users/14a354aa586d44ad803850134bb9ec18 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:10:31.726093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6ef51-ab7a-4696-9666-826fca10045c service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:10:31.740712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6ef51-ab7a-4696-9666-826fca10045c service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:10:31.807216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:10:31.807860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:31.808139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:31.808412 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] PATH_INFO: `/v3/projects/14eef693ac13498faef8417fa2e48238` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:31.809723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14eef693ac13498faef8417fa2e48238)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:10:31.811632 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:10:31.860156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14eef693ac13498faef8417fa2e48238', 'request_id': 'req-0381ca86-3efe-4940-aa15-557d33e64311'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:31.866356 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14eef693ac13498faef8417fa2e48238', 'request_id': 'req-0381ca86-3efe-4940-aa15-557d33e64311'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:31.874721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14eef693ac13498faef8417fa2e48238', 'request_id': 'req-0381ca86-3efe-4940-aa15-557d33e64311'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:31.885645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] The token cache is being invalidate because project 14eef693ac13498faef8417fa2e48238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:10:31.886027 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:31.886783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:31.888266 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1237/2482] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:10:31 2022] DELETE /identity/v3/projects/14eef693ac13498faef8417fa2e48238 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:10:31.892508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:10:31.894076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:31.907276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb48b31-821f-4afb-81de-7f09b64ff45c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:10:31.910712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:31.965437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:10:31.966072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:31.966352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:31.966625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] PATH_INFO: `/v3/users/381b30cab19b41608e675bc7ebf2da61` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:31.967797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381b30cab19b41608e675bc7ebf2da61)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:10:31.969980 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:10:32.015706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381b30cab19b41608e675bc7ebf2da61'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:32.016447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381b30cab19b41608e675bc7ebf2da61'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:32.028596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381b30cab19b41608e675bc7ebf2da61'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:32.035605 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381b30cab19b41608e675bc7ebf2da61'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:32.036711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381b30cab19b41608e675bc7ebf2da61'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:32.050665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1246/2483] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:10:31 2022] DELETE /identity/v3/users/381b30cab19b41608e675bc7ebf2da61 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:10:32.226801 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:10:32.228286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:32.238825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:32.243212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381ca86-3efe-4940-aa15-557d33e64311 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:10:32.311635 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:10:32.312271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:32.312577 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:32.312853 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] PATH_INFO: `/v3/projects/1e378d2f57f64840982c8fc5c6e0ef9f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:32.314026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e378d2f57f64840982c8fc5c6e0ef9f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:10:32.316364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:10:32.364825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e378d2f57f64840982c8fc5c6e0ef9f', 'request_id': 'req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:32.371233 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e378d2f57f64840982c8fc5c6e0ef9f', 'request_id': 'req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:32.379507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e378d2f57f64840982c8fc5c6e0ef9f', 'request_id': 'req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:32.390581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] The token cache is being invalidate because project 1e378d2f57f64840982c8fc5c6e0ef9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:10:32.390870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:32.391509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:10:32.393036 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1238/2484] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:10:32 2022] DELETE /identity/v3/projects/1e378d2f57f64840982c8fc5c6e0ef9f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:10:42.047162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:42.387583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:59.159255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:10:59.160714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:59.217299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f166a-9e38-4af2-b1d9-ea4a80ac56d6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:10:59.265080 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8dc2c-0aa7-430c-a31f-4ddb17cd19b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:10:59.265690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8dc2c-0aa7-430c-a31f-4ddb17cd19b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:10:59.265971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8dc2c-0aa7-430c-a31f-4ddb17cd19b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:10:59.266244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8dc2c-0aa7-430c-a31f-4ddb17cd19b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:10:59.267976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5fe8dc2c-0aa7-430c-a31f-4ddb17cd19b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:10:59.325981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8dc2c-0aa7-430c-a31f-4ddb17cd19b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:10:59.327408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8dc2c-0aa7-430c-a31f-4ddb17cd19b9 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:10:59.336246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1247/2485] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:10:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:09.332146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=68 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:18.000994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:18.002394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:18.061036 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50c7b3-6eec-40f2-b304-b9e8d4e1e5f0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:18.064619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e8a9d-4c51-4557-85c8-37f209ecee03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:18.065234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e8a9d-4c51-4557-85c8-37f209ecee03 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:18.065512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e8a9d-4c51-4557-85c8-37f209ecee03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:18.065785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e8a9d-4c51-4557-85c8-37f209ecee03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:18.067468 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-686e8a9d-4c51-4557-85c8-37f209ecee03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:18.131411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e8a9d-4c51-4557-85c8-37f209ecee03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:18.132822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e8a9d-4c51-4557-85c8-37f209ecee03 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:18.142520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1239/2486] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:21.309285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8dc2c-0aa7-430c-a31f-4ddb17cd19b9 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:21.311317 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5fe8dc2c-0aa7-430c-a31f-4ddb17cd19b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:21.327658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8dc2c-0aa7-430c-a31f-4ddb17cd19b9 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:21.333048 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:21.333707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:21.333991 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:21.334511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] PATH_INFO: `/v3/users/7177f283d8304de19d19230ba2e61084` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:21.335659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7177f283d8304de19d19230ba2e61084)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:21.343124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:21.394080 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7177f283d8304de19d19230ba2e61084'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:21.394654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7177f283d8304de19d19230ba2e61084'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:21.409285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7177f283d8304de19d19230ba2e61084'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:21.418228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7177f283d8304de19d19230ba2e61084'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:21.419856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9e1054c9-76e5-46fa-8f90-43dc38cbe193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7177f283d8304de19d19230ba2e61084'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:21.446881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1248/2487] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:11:21 2022] DELETE /identity/v3/users/7177f283d8304de19d19230ba2e61084 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:21.644259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e8a9d-4c51-4557-85c8-37f209ecee03 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:21.655319 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e8a9d-4c51-4557-85c8-37f209ecee03 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:21.716748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:21.717643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:21.717925 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:21.718199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] PATH_INFO: `/v3/projects/6ad1d65d1eab401ea6e1888aed1b3a32` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:21.719341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad1d65d1eab401ea6e1888aed1b3a32)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:21.721284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:21.768279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad1d65d1eab401ea6e1888aed1b3a32', 'request_id': 'req-dcd74c6e-a606-4270-a4c2-388843384f18'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:21.774765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:21.783116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad1d65d1eab401ea6e1888aed1b3a32', 'request_id': 'req-dcd74c6e-a606-4270-a4c2-388843384f18'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:21.786518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad1d65d1eab401ea6e1888aed1b3a32', 'request_id': 'req-dcd74c6e-a606-4270-a4c2-388843384f18'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:21.797605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] The token cache is being invalidate because project 6ad1d65d1eab401ea6e1888aed1b3a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:11:21.797897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:21.798573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-dcd74c6e-a606-4270-a4c2-388843384f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:21.800020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1240/2488] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:11:21 2022] DELETE /identity/v3/projects/6ad1d65d1eab401ea6e1888aed1b3a32 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:21.804986 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef408-a7f3-491d-ac4f-ff09ba220ae4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:21.805279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef408-a7f3-491d-ac4f-ff09ba220ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:21.805565 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef408-a7f3-491d-ac4f-ff09ba220ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:21.826478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5c3ef408-a7f3-491d-ac4f-ff09ba220ae4 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:21.827694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5c3ef408-a7f3-491d-ac4f-ff09ba220ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:21.885643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1249/2489] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:21.894468 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578a6d7-0fe9-45ab-8b0c-08ad449ededc None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:21.894752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578a6d7-0fe9-45ab-8b0c-08ad449ededc None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:21.895030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578a6d7-0fe9-45ab-8b0c-08ad449ededc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:21.914798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2578a6d7-0fe9-45ab-8b0c-08ad449ededc None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:21.916010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2578a6d7-0fe9-45ab-8b0c-08ad449ededc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:21.925401 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1241/2490] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:21.930245 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ef408-a7f3-491d-ac4f-ff09ba220ae4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:21.940737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ef408-a7f3-491d-ac4f-ff09ba220ae4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:21.945288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266409f-c4c5-4c31-a9d2-6447c3bf0525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:21.945878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266409f-c4c5-4c31-a9d2-6447c3bf0525 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:21.946154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266409f-c4c5-4c31-a9d2-6447c3bf0525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:21.946422 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266409f-c4c5-4c31-a9d2-6447c3bf0525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:21.947059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266409f-c4c5-4c31-a9d2-6447c3bf0525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:11:21.947357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266409f-c4c5-4c31-a9d2-6447c3bf0525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:21.948973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266409f-c4c5-4c31-a9d2-6447c3bf0525 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:21.960618 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1250/2491] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 17:11:21.965004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578a6d7-0fe9-45ab-8b0c-08ad449ededc None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:21.974394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578a6d7-0fe9-45ab-8b0c-08ad449ededc None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:21.979073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be84ff6-9415-4d02-9c88-3d54ec83db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:21.979666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be84ff6-9415-4d02-9c88-3d54ec83db33 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:21.979946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be84ff6-9415-4d02-9c88-3d54ec83db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:21.980219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be84ff6-9415-4d02-9c88-3d54ec83db33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:21.980872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be84ff6-9415-4d02-9c88-3d54ec83db33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:21.983264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be84ff6-9415-4d02-9c88-3d54ec83db33 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.010778 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1242/2492] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:11:21 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:22.014897 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266409f-c4c5-4c31-a9d2-6447c3bf0525 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.024912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266409f-c4c5-4c31-a9d2-6447c3bf0525 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.079683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ed703-0ede-463e-9b71-e539625149ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.080287 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ed703-0ede-463e-9b71-e539625149ff admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.080595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ed703-0ede-463e-9b71-e539625149ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.080865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ed703-0ede-463e-9b71-e539625149ff admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.081488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ed703-0ede-463e-9b71-e539625149ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.083373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ed703-0ede-463e-9b71-e539625149ff admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.091160 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:22.105472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1251/2493] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:11:22 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:11:22.110285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be84ff6-9415-4d02-9c88-3d54ec83db33 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.120383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be84ff6-9415-4d02-9c88-3d54ec83db33 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.125834 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eace73-95a2-4623-b9be-2eb33078e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.126443 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eace73-95a2-4623-b9be-2eb33078e467 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.126722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eace73-95a2-4623-b9be-2eb33078e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.127006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eace73-95a2-4623-b9be-2eb33078e467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.127637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eace73-95a2-4623-b9be-2eb33078e467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.129318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eace73-95a2-4623-b9be-2eb33078e467 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.139359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1243/2494] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:11:22.143387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ed703-0ede-463e-9b71-e539625149ff admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.153891 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ed703-0ede-463e-9b71-e539625149ff admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.158415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19737acd-2a66-40c8-90f2-eaa2bf006360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.159014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737acd-2a66-40c8-90f2-eaa2bf006360 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.159292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737acd-2a66-40c8-90f2-eaa2bf006360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.159570 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737acd-2a66-40c8-90f2-eaa2bf006360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.160236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19737acd-2a66-40c8-90f2-eaa2bf006360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.161848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19737acd-2a66-40c8-90f2-eaa2bf006360 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.172789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1252/2495] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:22.176804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eace73-95a2-4623-b9be-2eb33078e467 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.186647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eace73-95a2-4623-b9be-2eb33078e467 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.191165 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea5d63-4d93-4432-9f9e-760c70df1676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.191804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea5d63-4d93-4432-9f9e-760c70df1676 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.192081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea5d63-4d93-4432-9f9e-760c70df1676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.192350 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea5d63-4d93-4432-9f9e-760c70df1676 admin admin] PATH_INFO: `/v3/projects/4e426cdeb03c497dbfc37bfda057098f/users/0750116c16044c68b5b148d62fecd6e3/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.206366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea5d63-4d93-4432-9f9e-760c70df1676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e426cdeb03c497dbfc37bfda057098f, user_id=0750116c16044c68b5b148d62fecd6e3, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.209015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea5d63-4d93-4432-9f9e-760c70df1676 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.222338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1244/2496] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:22 2022] PUT /identity/v3/projects/4e426cdeb03c497dbfc37bfda057098f/users/0750116c16044c68b5b148d62fecd6e3/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:22.232940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fd8dc-7244-4973-a364-149c5ccbd412 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.233225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fd8dc-7244-4973-a364-149c5ccbd412 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.233502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fd8dc-7244-4973-a364-149c5ccbd412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.260714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5a6fd8dc-7244-4973-a364-149c5ccbd412 None None] MFA Rules not processed for user `0750116c16044c68b5b148d62fecd6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:22.261925 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5a6fd8dc-7244-4973-a364-149c5ccbd412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:22.324354 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1253/2497] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:22.328776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea5d63-4d93-4432-9f9e-760c70df1676 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.389658 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea5d63-4d93-4432-9f9e-760c70df1676 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.394286 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fc58b-470d-4600-b506-a1bcecbb8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.394894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fc58b-470d-4600-b506-a1bcecbb8379 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.395171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fc58b-470d-4600-b506-a1bcecbb8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.395445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fc58b-470d-4600-b506-a1bcecbb8379 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.396074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fc58b-470d-4600-b506-a1bcecbb8379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.397994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fc58b-470d-4600-b506-a1bcecbb8379 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.427488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1245/2498] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:11:22 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:22.428580 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fd8dc-7244-4973-a364-149c5ccbd412 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.439409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fd8dc-7244-4973-a364-149c5ccbd412 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.496903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308f5f6-c11f-4006-922d-ee5f93f2e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.497518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308f5f6-c11f-4006-922d-ee5f93f2e405 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.497801 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308f5f6-c11f-4006-922d-ee5f93f2e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.498074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308f5f6-c11f-4006-922d-ee5f93f2e405 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.498700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308f5f6-c11f-4006-922d-ee5f93f2e405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.500650 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308f5f6-c11f-4006-922d-ee5f93f2e405 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.521930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1254/2499] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:11:22 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:11:22.526181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fc58b-470d-4600-b506-a1bcecbb8379 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.536971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fc58b-470d-4600-b506-a1bcecbb8379 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.541523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb4e1-6c56-47cd-99da-2878f1e31d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.542116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb4e1-6c56-47cd-99da-2878f1e31d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.542394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb4e1-6c56-47cd-99da-2878f1e31d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.542668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bb4e1-6c56-47cd-99da-2878f1e31d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.543307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bb4e1-6c56-47cd-99da-2878f1e31d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.545552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bb4e1-6c56-47cd-99da-2878f1e31d90 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.555953 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1246/2500] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:22.560363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308f5f6-c11f-4006-922d-ee5f93f2e405 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.570360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308f5f6-c11f-4006-922d-ee5f93f2e405 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.574957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdd1f6-43cf-4e18-a71e-106334d1f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.576081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdd1f6-43cf-4e18-a71e-106334d1f61c admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.576365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdd1f6-43cf-4e18-a71e-106334d1f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.576675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdd1f6-43cf-4e18-a71e-106334d1f61c admin admin] PATH_INFO: `/v3/projects/7acf7f0bf6dc4b6ba443bef4bf53f02c/users/2133481723c542d7a7a7c702f98fdda2/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.591721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdd1f6-43cf-4e18-a71e-106334d1f61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acf7f0bf6dc4b6ba443bef4bf53f02c, user_id=2133481723c542d7a7a7c702f98fdda2, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.594645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdd1f6-43cf-4e18-a71e-106334d1f61c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.608110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1255/2501] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:22 2022] PUT /identity/v3/projects/7acf7f0bf6dc4b6ba443bef4bf53f02c/users/2133481723c542d7a7a7c702f98fdda2/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:22.612115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb4e1-6c56-47cd-99da-2878f1e31d90 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.622297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bb4e1-6c56-47cd-99da-2878f1e31d90 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.669419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:22.681370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a48414-6745-4851-aaaf-9878f207e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.681986 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a48414-6745-4851-aaaf-9878f207e591 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.682267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a48414-6745-4851-aaaf-9878f207e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.682541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a48414-6745-4851-aaaf-9878f207e591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.683184 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a48414-6745-4851-aaaf-9878f207e591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.684904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a48414-6745-4851-aaaf-9878f207e591 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.695006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1247/2502] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:22.699223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdd1f6-43cf-4e18-a71e-106334d1f61c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.709960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdd1f6-43cf-4e18-a71e-106334d1f61c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.714573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cefdd5-946a-47d1-8c21-27b337e7953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.715223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cefdd5-946a-47d1-8c21-27b337e7953f admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.715500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cefdd5-946a-47d1-8c21-27b337e7953f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.716445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cefdd5-946a-47d1-8c21-27b337e7953f admin admin] PATH_INFO: `/v3/projects/7acf7f0bf6dc4b6ba443bef4bf53f02c/users/2133481723c542d7a7a7c702f98fdda2/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.718589 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cefdd5-946a-47d1-8c21-27b337e7953f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acf7f0bf6dc4b6ba443bef4bf53f02c, user_id=2133481723c542d7a7a7c702f98fdda2, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.721262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cefdd5-946a-47d1-8c21-27b337e7953f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.731660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1256/2503] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:22 2022] PUT /identity/v3/projects/7acf7f0bf6dc4b6ba443bef4bf53f02c/users/2133481723c542d7a7a7c702f98fdda2/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:22.743339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c21e09-098b-45f6-b0bd-8545c1b832d9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.743629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c21e09-098b-45f6-b0bd-8545c1b832d9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.743907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c21e09-098b-45f6-b0bd-8545c1b832d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.771583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-01c21e09-098b-45f6-b0bd-8545c1b832d9 None None] MFA Rules not processed for user `2133481723c542d7a7a7c702f98fdda2`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:22.772794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-01c21e09-098b-45f6-b0bd-8545c1b832d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:22.840015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1248/2504] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:22.851718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cefdd5-946a-47d1-8c21-27b337e7953f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:22.853529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-09cefdd5-946a-47d1-8c21-27b337e7953f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:22.875515 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:22.912683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cefdd5-946a-47d1-8c21-27b337e7953f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:22.919679 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aefb4-50f1-4f79-87e0-aaf761aeef73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:22.920269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aefb4-50f1-4f79-87e0-aaf761aeef73 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:22.920603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aefb4-50f1-4f79-87e0-aaf761aeef73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:22.920988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aefb4-50f1-4f79-87e0-aaf761aeef73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:22.932591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aefb4-50f1-4f79-87e0-aaf761aeef73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:22.934029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aefb4-50f1-4f79-87e0-aaf761aeef73 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:22.944064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1257/2505] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:22.972936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c21e09-098b-45f6-b0bd-8545c1b832d9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:23.034718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c21e09-098b-45f6-b0bd-8545c1b832d9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:23.039304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:23.039948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:23.040410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:23.040540 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] PATH_INFO: `/v3/users/0750116c16044c68b5b148d62fecd6e3` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:23.041628 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0750116c16044c68b5b148d62fecd6e3)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:23.043540 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:23.093295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0750116c16044c68b5b148d62fecd6e3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.100591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0750116c16044c68b5b148d62fecd6e3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.101171 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0750116c16044c68b5b148d62fecd6e3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.101764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0750116c16044c68b5b148d62fecd6e3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.108669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0750116c16044c68b5b148d62fecd6e3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.116415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:23.128186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1249/2506] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:11:22 2022] DELETE /identity/v3/users/0750116c16044c68b5b148d62fecd6e3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:23.132828 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a15ce3-d0a4-4438-83ca-38e5be9300e9 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:23.133111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a15ce3-d0a4-4438-83ca-38e5be9300e9 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:23.133385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a15ce3-d0a4-4438-83ca-38e5be9300e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:23.152180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c5a15ce3-d0a4-4438-83ca-38e5be9300e9 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:23.153443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c5a15ce3-d0a4-4438-83ca-38e5be9300e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:23.211185 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1258/2507] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:23.221314 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:23.222792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:23.280025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899e2b-f860-41e2-a9e7-924102111522 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:23.283852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005961da-23ad-4bb7-a967-a014bad69c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:23.284477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005961da-23ad-4bb7-a967-a014bad69c65 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:23.284765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005961da-23ad-4bb7-a967-a014bad69c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:23.285579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005961da-23ad-4bb7-a967-a014bad69c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:23.294832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005961da-23ad-4bb7-a967-a014bad69c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:23.296250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005961da-23ad-4bb7-a967-a014bad69c65 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:23.305817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1250/2508] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:23.573159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a15ce3-d0a4-4438-83ca-38e5be9300e9 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:23.574691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c5a15ce3-d0a4-4438-83ca-38e5be9300e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:23.586817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a15ce3-d0a4-4438-83ca-38e5be9300e9 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:23.591830 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:23.592775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:23.593045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:23.593345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] PATH_INFO: `/v3/projects/4e426cdeb03c497dbfc37bfda057098f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:23.594526 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e426cdeb03c497dbfc37bfda057098f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:23.596473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:23.644660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e426cdeb03c497dbfc37bfda057098f', 'request_id': 'req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.652095 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e426cdeb03c497dbfc37bfda057098f', 'request_id': 'req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.659305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e426cdeb03c497dbfc37bfda057098f', 'request_id': 'req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.670399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] The token cache is being invalidate because project 4e426cdeb03c497dbfc37bfda057098f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:11:23.670689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.671358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.672877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1259/2509] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:11:23 2022] DELETE /identity/v3/projects/4e426cdeb03c497dbfc37bfda057098f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:23.676886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005961da-23ad-4bb7-a967-a014bad69c65 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:23.687120 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005961da-23ad-4bb7-a967-a014bad69c65 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:23.743417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:23.744061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:23.744341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:23.744663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] PATH_INFO: `/v3/users/2133481723c542d7a7a7c702f98fdda2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:23.745777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2133481723c542d7a7a7c702f98fdda2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:23.748288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:23.794377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2133481723c542d7a7a7c702f98fdda2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.801601 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2133481723c542d7a7a7c702f98fdda2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.802310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2133481723c542d7a7a7c702f98fdda2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.802914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2133481723c542d7a7a7c702f98fdda2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.810854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-e4f6c78d-6bf4-4210-a6c5-5d7b05dd9430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2133481723c542d7a7a7c702f98fdda2'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:23.829173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1251/2510] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:11:23 2022] DELETE /identity/v3/users/2133481723c542d7a7a7c702f98fdda2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:24.101875 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:24.103299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:24.117311 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b201f-21e8-4ffb-87d3-c6d68e41f4e2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:24.163370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:24.178367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:24.179122 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.179456 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.179678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] PATH_INFO: `/v3/projects/7acf7f0bf6dc4b6ba443bef4bf53f02c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.180849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7acf7f0bf6dc4b6ba443bef4bf53f02c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:24.182786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:24.227709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7acf7f0bf6dc4b6ba443bef4bf53f02c', 'request_id': 'req-59fa6aab-6b10-4b1e-9e04-eee4e9647057'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:24.234904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7acf7f0bf6dc4b6ba443bef4bf53f02c', 'request_id': 'req-59fa6aab-6b10-4b1e-9e04-eee4e9647057'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:24.241289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7acf7f0bf6dc4b6ba443bef4bf53f02c', 'request_id': 'req-59fa6aab-6b10-4b1e-9e04-eee4e9647057'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:24.252161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] The token cache is being invalidate because project 7acf7f0bf6dc4b6ba443bef4bf53f02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:11:24.252447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:24.253104 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-59fa6aab-6b10-4b1e-9e04-eee4e9647057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:24.254959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1260/2511] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:11:24 2022] DELETE /identity/v3/projects/7acf7f0bf6dc4b6ba443bef4bf53f02c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:24.259979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a5f2-8278-4445-b0d7-f55ce01c032a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.260267 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a5f2-8278-4445-b0d7-f55ce01c032a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.260649 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a5f2-8278-4445-b0d7-f55ce01c032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.280284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ac07a5f2-8278-4445-b0d7-f55ce01c032a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:24.281521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ac07a5f2-8278-4445-b0d7-f55ce01c032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:24.289863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:24.342947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1252/2512] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:24.350629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cd025-3abc-4c97-86d2-e13621a56fd2 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.350913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cd025-3abc-4c97-86d2-e13621a56fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.351190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cd025-3abc-4c97-86d2-e13621a56fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.371077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-109cd025-3abc-4c97-86d2-e13621a56fd2 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:24.372948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-109cd025-3abc-4c97-86d2-e13621a56fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:24.380744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1261/2513] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:24.384919 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a5f2-8278-4445-b0d7-f55ce01c032a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:24.394758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a5f2-8278-4445-b0d7-f55ce01c032a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:24.399312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530816a-e653-46f8-8519-7771e6acf9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:24.399910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530816a-e653-46f8-8519-7771e6acf9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.400190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530816a-e653-46f8-8519-7771e6acf9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.400486 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530816a-e653-46f8-8519-7771e6acf9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.401160 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530816a-e653-46f8-8519-7771e6acf9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:11:24.401462 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530816a-e653-46f8-8519-7771e6acf9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:24.403569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530816a-e653-46f8-8519-7771e6acf9cd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:24.415089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1253/2514] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:11:24.419808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cd025-3abc-4c97-86d2-e13621a56fd2 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:24.428895 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cd025-3abc-4c97-86d2-e13621a56fd2 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:24.433513 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23616bee-d2e7-4a98-85e7-6a5d193132f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:24.434051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23616bee-d2e7-4a98-85e7-6a5d193132f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.434340 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23616bee-d2e7-4a98-85e7-6a5d193132f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.434613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23616bee-d2e7-4a98-85e7-6a5d193132f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.435241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23616bee-d2e7-4a98-85e7-6a5d193132f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:24.437180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23616bee-d2e7-4a98-85e7-6a5d193132f7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:24.463693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1262/2515] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:11:24 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:24.468708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530816a-e653-46f8-8519-7771e6acf9cd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:24.478643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530816a-e653-46f8-8519-7771e6acf9cd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:24.534470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d0c97-5c04-45de-9b9d-1f1740a0aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:24.535084 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d0c97-5c04-45de-9b9d-1f1740a0aff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.535361 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d0c97-5c04-45de-9b9d-1f1740a0aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.535634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d0c97-5c04-45de-9b9d-1f1740a0aff2 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.536263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d0c97-5c04-45de-9b9d-1f1740a0aff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:24.538192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d0c97-5c04-45de-9b9d-1f1740a0aff2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:24.560969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1254/2516] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:11:24 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:24.565130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23616bee-d2e7-4a98-85e7-6a5d193132f7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:24.575618 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23616bee-d2e7-4a98-85e7-6a5d193132f7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:24.580236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067cfb9-ae1e-400f-bc4d-99243ec98e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:24.580885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067cfb9-ae1e-400f-bc4d-99243ec98e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.581136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067cfb9-ae1e-400f-bc4d-99243ec98e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.581407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067cfb9-ae1e-400f-bc4d-99243ec98e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.582038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067cfb9-ae1e-400f-bc4d-99243ec98e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:24.583615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067cfb9-ae1e-400f-bc4d-99243ec98e1d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:24.594115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1263/2517] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:24.598097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d0c97-5c04-45de-9b9d-1f1740a0aff2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:24.609795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d0c97-5c04-45de-9b9d-1f1740a0aff2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:24.614434 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3d563-76fa-4200-80f2-35d15b9eb0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:24.615070 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3d563-76fa-4200-80f2-35d15b9eb0bb admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.615356 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3d563-76fa-4200-80f2-35d15b9eb0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.615634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3d563-76fa-4200-80f2-35d15b9eb0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.616624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3d563-76fa-4200-80f2-35d15b9eb0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:24.618217 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3d563-76fa-4200-80f2-35d15b9eb0bb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:24.628927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1255/2518] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:24.633613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067cfb9-ae1e-400f-bc4d-99243ec98e1d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:24.643664 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067cfb9-ae1e-400f-bc4d-99243ec98e1d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:24.648281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bae75b-a359-46aa-ad3c-3645b1a707dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:24.648954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bae75b-a359-46aa-ad3c-3645b1a707dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.649231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bae75b-a359-46aa-ad3c-3645b1a707dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.649502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bae75b-a359-46aa-ad3c-3645b1a707dd admin admin] PATH_INFO: `/v3/projects/2817a10896774735b6993bd85174d37c/users/f5c4868af98f4c6cbc6c64a53861e895/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.664532 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bae75b-a359-46aa-ad3c-3645b1a707dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2817a10896774735b6993bd85174d37c, user_id=f5c4868af98f4c6cbc6c64a53861e895, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:24.667171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bae75b-a359-46aa-ad3c-3645b1a707dd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:24.680669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1264/2519] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:24 2022] PUT /identity/v3/projects/2817a10896774735b6993bd85174d37c/users/f5c4868af98f4c6cbc6c64a53861e895/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:11:24.692570 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b221de1-f02b-447c-874d-562e2465f9f5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.693134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b221de1-f02b-447c-874d-562e2465f9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.693134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b221de1-f02b-447c-874d-562e2465f9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.721768 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7b221de1-f02b-447c-874d-562e2465f9f5 None None] MFA Rules not processed for user `f5c4868af98f4c6cbc6c64a53861e895`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:24.723505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7b221de1-f02b-447c-874d-562e2465f9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:24.788825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1256/2520] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:24.793256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bae75b-a359-46aa-ad3c-3645b1a707dd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:24.854386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bae75b-a359-46aa-ad3c-3645b1a707dd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:24.859229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd9fbe-eeb8-4bd3-9b7c-cd6d7154a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:24.859839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd9fbe-eeb8-4bd3-9b7c-cd6d7154a2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.860123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd9fbe-eeb8-4bd3-9b7c-cd6d7154a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.860436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd9fbe-eeb8-4bd3-9b7c-cd6d7154a2a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.861097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd9fbe-eeb8-4bd3-9b7c-cd6d7154a2a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:24.862999 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd9fbe-eeb8-4bd3-9b7c-cd6d7154a2a5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:24.882293 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:24.890505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1265/2521] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:11:24 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:24.894828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b221de1-f02b-447c-874d-562e2465f9f5 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:24.906723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b221de1-f02b-447c-874d-562e2465f9f5 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:24.911262 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:24.964891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e6094-ab53-4349-b58d-81bc458afce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:24.965411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e6094-ab53-4349-b58d-81bc458afce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:24.966263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e6094-ab53-4349-b58d-81bc458afce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:24.966505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e6094-ab53-4349-b58d-81bc458afce3 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:24.967574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e6094-ab53-4349-b58d-81bc458afce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:24.969509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e6094-ab53-4349-b58d-81bc458afce3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:24.989918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1257/2522] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:11:24 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:24.994059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd9fbe-eeb8-4bd3-9b7c-cd6d7154a2a5 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:25.004229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd9fbe-eeb8-4bd3-9b7c-cd6d7154a2a5 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:25.008836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb24bf-53f3-4d86-90bf-250f8d940dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:25.009435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb24bf-53f3-4d86-90bf-250f8d940dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:25.009718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb24bf-53f3-4d86-90bf-250f8d940dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:25.009995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb24bf-53f3-4d86-90bf-250f8d940dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:25.010635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb24bf-53f3-4d86-90bf-250f8d940dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:25.012264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb24bf-53f3-4d86-90bf-250f8d940dc9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:25.023222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1266/2523] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:25.027609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e6094-ab53-4349-b58d-81bc458afce3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:25.038338 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e6094-ab53-4349-b58d-81bc458afce3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:25.043348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477f440-e399-4406-a2da-60b4323e7159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:25.044241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477f440-e399-4406-a2da-60b4323e7159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:25.044592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477f440-e399-4406-a2da-60b4323e7159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:25.044873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477f440-e399-4406-a2da-60b4323e7159 admin admin] PATH_INFO: `/v3/projects/eea2078290894cb7930a1befe855f026/users/a5660de1cf75485c926345535570c7c5/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:25.062565 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477f440-e399-4406-a2da-60b4323e7159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea2078290894cb7930a1befe855f026, user_id=a5660de1cf75485c926345535570c7c5, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:25.065250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477f440-e399-4406-a2da-60b4323e7159 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:25.078387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1258/2524] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:25 2022] PUT /identity/v3/projects/eea2078290894cb7930a1befe855f026/users/a5660de1cf75485c926345535570c7c5/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:11:25.082385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb24bf-53f3-4d86-90bf-250f8d940dc9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:25.093460 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb24bf-53f3-4d86-90bf-250f8d940dc9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:25.149403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672fb02-2af8-4059-ba7a-482c8cd8bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:25.150013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672fb02-2af8-4059-ba7a-482c8cd8bf0d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:25.150294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672fb02-2af8-4059-ba7a-482c8cd8bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:25.150564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672fb02-2af8-4059-ba7a-482c8cd8bf0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:25.151200 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672fb02-2af8-4059-ba7a-482c8cd8bf0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:25.152823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672fb02-2af8-4059-ba7a-482c8cd8bf0d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:25.163343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1267/2525] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:25.167536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477f440-e399-4406-a2da-60b4323e7159 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:25.178154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477f440-e399-4406-a2da-60b4323e7159 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:25.183227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e597658-a47e-4da8-b648-786adb905833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:25.183899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e597658-a47e-4da8-b648-786adb905833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:25.184181 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e597658-a47e-4da8-b648-786adb905833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:25.184990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e597658-a47e-4da8-b648-786adb905833 admin admin] PATH_INFO: `/v3/projects/eea2078290894cb7930a1befe855f026/users/a5660de1cf75485c926345535570c7c5/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:25.186942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e597658-a47e-4da8-b648-786adb905833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea2078290894cb7930a1befe855f026, user_id=a5660de1cf75485c926345535570c7c5, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:25.189605 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e597658-a47e-4da8-b648-786adb905833 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:25.201388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1259/2526] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:25 2022] PUT /identity/v3/projects/eea2078290894cb7930a1befe855f026/users/a5660de1cf75485c926345535570c7c5/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:25.211348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d337be-9dc6-40f8-a2f8-bd7286e05261 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:25.211635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d337be-9dc6-40f8-a2f8-bd7286e05261 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:25.211911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d337be-9dc6-40f8-a2f8-bd7286e05261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:25.246059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-17d337be-9dc6-40f8-a2f8-bd7286e05261 None None] MFA Rules not processed for user `a5660de1cf75485c926345535570c7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:25.247684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-17d337be-9dc6-40f8-a2f8-bd7286e05261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:25.318284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1268/2527] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:25.330510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e597658-a47e-4da8-b648-786adb905833 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:25.332259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2e597658-a47e-4da8-b648-786adb905833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:25.392436 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e597658-a47e-4da8-b648-786adb905833 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:25.396065 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418dce7-cbd2-488a-8adf-8e0b2cbc2c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:25.396694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418dce7-cbd2-488a-8adf-8e0b2cbc2c4a service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:25.396970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418dce7-cbd2-488a-8adf-8e0b2cbc2c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:25.397240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418dce7-cbd2-488a-8adf-8e0b2cbc2c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:25.405968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418dce7-cbd2-488a-8adf-8e0b2cbc2c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:25.407384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418dce7-cbd2-488a-8adf-8e0b2cbc2c4a service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:25.416556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1260/2528] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:25.504294 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d337be-9dc6-40f8-a2f8-bd7286e05261 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:25.514587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d337be-9dc6-40f8-a2f8-bd7286e05261 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:25.518196 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6070c-7c9b-4762-9c04-a80808ac6faa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:25.518799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6070c-7c9b-4762-9c04-a80808ac6faa service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:25.519086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6070c-7c9b-4762-9c04-a80808ac6faa service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:25.519364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6070c-7c9b-4762-9c04-a80808ac6faa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:25.576640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6070c-7c9b-4762-9c04-a80808ac6faa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:25.578073 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6070c-7c9b-4762-9c04-a80808ac6faa service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:25.586944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1269/2529] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:25.854866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418dce7-cbd2-488a-8adf-8e0b2cbc2c4a service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:25.915723 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418dce7-cbd2-488a-8adf-8e0b2cbc2c4a service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:25.920897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:25.921532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:25.921813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:25.922087 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] PATH_INFO: `/v3/users/f5c4868af98f4c6cbc6c64a53861e895` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:25.923232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c4868af98f4c6cbc6c64a53861e895)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:25.925257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:25.932034 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:25.975418 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c4868af98f4c6cbc6c64a53861e895'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:25.982890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c4868af98f4c6cbc6c64a53861e895'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:25.983503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c4868af98f4c6cbc6c64a53861e895'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:25.984106 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c4868af98f4c6cbc6c64a53861e895'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:25.990926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c4868af98f4c6cbc6c64a53861e895'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.008689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1261/2530] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:11:25 2022] DELETE /identity/v3/users/f5c4868af98f4c6cbc6c64a53861e895 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:11:26.013237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed516a8-da51-4dca-88ea-9d4af227b405 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:26.013527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed516a8-da51-4dca-88ea-9d4af227b405 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:26.013807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed516a8-da51-4dca-88ea-9d4af227b405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:26.026932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=100 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:26.033455 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9ed516a8-da51-4dca-88ea-9d4af227b405 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:26.034684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9ed516a8-da51-4dca-88ea-9d4af227b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:26.094509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1270/2531] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:26.104260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:26.105686 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:26.164323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c332bb-97a9-4e62-bed8-6d4d4a524981 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:26.167110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7b257-8634-437d-acde-20c427efaa33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:26.167730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7b257-8634-437d-acde-20c427efaa33 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:26.168016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7b257-8634-437d-acde-20c427efaa33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:26.168293 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7b257-8634-437d-acde-20c427efaa33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:26.178386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7b257-8634-437d-acde-20c427efaa33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:26.179916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7b257-8634-437d-acde-20c427efaa33 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:26.190907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1262/2532] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:26.458684 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed516a8-da51-4dca-88ea-9d4af227b405 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:26.460108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9ed516a8-da51-4dca-88ea-9d4af227b405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:26.473767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed516a8-da51-4dca-88ea-9d4af227b405 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:26.478713 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:26.479457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:26.479803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:26.480142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] PATH_INFO: `/v3/projects/2817a10896774735b6993bd85174d37c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:26.481426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2817a10896774735b6993bd85174d37c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:26.483410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:26.533000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2817a10896774735b6993bd85174d37c', 'request_id': 'req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.540107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2817a10896774735b6993bd85174d37c', 'request_id': 'req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.546370 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2817a10896774735b6993bd85174d37c', 'request_id': 'req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.556491 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] The token cache is being invalidate because project 2817a10896774735b6993bd85174d37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:11:26.556788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.557472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.558948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1271/2533] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:11:26 2022] DELETE /identity/v3/projects/2817a10896774735b6993bd85174d37c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:26.563112 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7b257-8634-437d-acde-20c427efaa33 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:26.573092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7b257-8634-437d-acde-20c427efaa33 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:26.629278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:26.629909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:26.630190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:26.630467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] PATH_INFO: `/v3/users/a5660de1cf75485c926345535570c7c5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:26.631587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5660de1cf75485c926345535570c7c5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:26.633962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:26.662520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:26.682677 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5660de1cf75485c926345535570c7c5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.690699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5660de1cf75485c926345535570c7c5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.691327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5660de1cf75485c926345535570c7c5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.691962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5660de1cf75485c926345535570c7c5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.698929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4e2d9b32-40b7-444f-be0b-479692d4a128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5660de1cf75485c926345535570c7c5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:26.716534 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1263/2534] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:11:26 2022] DELETE /identity/v3/users/a5660de1cf75485c926345535570c7c5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:26.994072 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:26.995572 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:27.010729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233dfda-fb7b-4e2a-8ba1-660426bd1e5d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.075994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.076579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.076863 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.077141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] PATH_INFO: `/v3/projects/eea2078290894cb7930a1befe855f026` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.078257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea2078290894cb7930a1befe855f026)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.080166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.114504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:27.129525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea2078290894cb7930a1befe855f026', 'request_id': 'req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:27.136716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea2078290894cb7930a1befe855f026', 'request_id': 'req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:27.142806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea2078290894cb7930a1befe855f026', 'request_id': 'req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:27.152929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] The token cache is being invalidate because project eea2078290894cb7930a1befe855f026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:11:27.153205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:27.153841 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a67f6abb-0257-4a67-84fc-e0e8ac7fac1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:27.155313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1272/2535] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:11:26 2022] DELETE /identity/v3/projects/eea2078290894cb7930a1befe855f026 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:27.160274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d80436-990b-4374-983b-c1c82e16951e None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.160785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d80436-990b-4374-983b-c1c82e16951e None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.160880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d80436-990b-4374-983b-c1c82e16951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.181659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-40d80436-990b-4374-983b-c1c82e16951e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:27.182856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-40d80436-990b-4374-983b-c1c82e16951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:27.241251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1264/2536] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:27.249509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d6ec-0401-442e-b2ed-99ec59d19c19 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.249795 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d6ec-0401-442e-b2ed-99ec59d19c19 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.250070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d6ec-0401-442e-b2ed-99ec59d19c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.269586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6339d6ec-0401-442e-b2ed-99ec59d19c19 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:27.270792 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6339d6ec-0401-442e-b2ed-99ec59d19c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:27.278649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1273/2537] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:27.282914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d80436-990b-4374-983b-c1c82e16951e None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.293398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d80436-990b-4374-983b-c1c82e16951e None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.298458 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003ea2-e582-4d74-ac66-85cdf7d6de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.299064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003ea2-e582-4d74-ac66-85cdf7d6de31 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.299341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003ea2-e582-4d74-ac66-85cdf7d6de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.299611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70003ea2-e582-4d74-ac66-85cdf7d6de31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.300252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70003ea2-e582-4d74-ac66-85cdf7d6de31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:11:27.300587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70003ea2-e582-4d74-ac66-85cdf7d6de31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.302168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70003ea2-e582-4d74-ac66-85cdf7d6de31 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.314309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1265/2538] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:11:27.318648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339d6ec-0401-442e-b2ed-99ec59d19c19 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.327983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339d6ec-0401-442e-b2ed-99ec59d19c19 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.332484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02630f72-cd51-497d-b583-e3a6f73495c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.333085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02630f72-cd51-497d-b583-e3a6f73495c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.333358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02630f72-cd51-497d-b583-e3a6f73495c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.333625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02630f72-cd51-497d-b583-e3a6f73495c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.334243 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02630f72-cd51-497d-b583-e3a6f73495c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.336108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02630f72-cd51-497d-b583-e3a6f73495c3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.363497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1274/2539] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:11:27 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:27.367466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003ea2-e582-4d74-ac66-85cdf7d6de31 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.379966 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70003ea2-e582-4d74-ac66-85cdf7d6de31 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.437073 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b929-e68e-4cba-bbbd-160f80de7556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.437697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b929-e68e-4cba-bbbd-160f80de7556 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.437968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b929-e68e-4cba-bbbd-160f80de7556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.438244 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b929-e68e-4cba-bbbd-160f80de7556 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.438861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533b929-e68e-4cba-bbbd-160f80de7556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.440808 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533b929-e68e-4cba-bbbd-160f80de7556 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.461330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1266/2540] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:11:27 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:27.466042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02630f72-cd51-497d-b583-e3a6f73495c3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.476573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02630f72-cd51-497d-b583-e3a6f73495c3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.481917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa33083-b8dd-45d2-af76-7376cfeca460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.482516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33083-b8dd-45d2-af76-7376cfeca460 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.482803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33083-b8dd-45d2-af76-7376cfeca460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.483076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33083-b8dd-45d2-af76-7376cfeca460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.483712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa33083-b8dd-45d2-af76-7376cfeca460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.485329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa33083-b8dd-45d2-af76-7376cfeca460 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.495247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1275/2541] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:27.499590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b929-e68e-4cba-bbbd-160f80de7556 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.509482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b929-e68e-4cba-bbbd-160f80de7556 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.514090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7ddb-cde6-4797-80f4-e9efa4ee5426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.514687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7ddb-cde6-4797-80f4-e9efa4ee5426 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.514968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7ddb-cde6-4797-80f4-e9efa4ee5426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.515261 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7ddb-cde6-4797-80f4-e9efa4ee5426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.515883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7ddb-cde6-4797-80f4-e9efa4ee5426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.517510 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7ddb-cde6-4797-80f4-e9efa4ee5426 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.528825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1267/2542] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:27.532776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa33083-b8dd-45d2-af76-7376cfeca460 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.542660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa33083-b8dd-45d2-af76-7376cfeca460 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.548015 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5fa12-e8e0-40ea-8c18-a1a6f04438da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.548707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5fa12-e8e0-40ea-8c18-a1a6f04438da admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.548990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5fa12-e8e0-40ea-8c18-a1a6f04438da admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.549282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5fa12-e8e0-40ea-8c18-a1a6f04438da admin admin] PATH_INFO: `/v3/projects/4012aa1f8def4121b868844a8c62e006/users/0a8e2ad5a8c04249b5bb6b3dab9b5446/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.563484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5fa12-e8e0-40ea-8c18-a1a6f04438da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4012aa1f8def4121b868844a8c62e006, user_id=0a8e2ad5a8c04249b5bb6b3dab9b5446, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.566149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5fa12-e8e0-40ea-8c18-a1a6f04438da admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.578812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1276/2543] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:27 2022] PUT /identity/v3/projects/4012aa1f8def4121b868844a8c62e006/users/0a8e2ad5a8c04249b5bb6b3dab9b5446/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:27.590121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c314-617e-446e-88ce-51a576b7440c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.590899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c314-617e-446e-88ce-51a576b7440c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.591182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c314-617e-446e-88ce-51a576b7440c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.612039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:27.620200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2751c314-617e-446e-88ce-51a576b7440c None None] MFA Rules not processed for user `0a8e2ad5a8c04249b5bb6b3dab9b5446`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:27.622742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2751c314-617e-446e-88ce-51a576b7440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:27.694002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1268/2544] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:11:27.698611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5fa12-e8e0-40ea-8c18-a1a6f04438da admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.760474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5fa12-e8e0-40ea-8c18-a1a6f04438da admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.765042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fea83c-440f-45ae-b24f-b9b2edae86e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.765645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fea83c-440f-45ae-b24f-b9b2edae86e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.765926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fea83c-440f-45ae-b24f-b9b2edae86e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.766198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fea83c-440f-45ae-b24f-b9b2edae86e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.766824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fea83c-440f-45ae-b24f-b9b2edae86e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.768736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fea83c-440f-45ae-b24f-b9b2edae86e0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.795492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1277/2545] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:11:27 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:27.799592 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c314-617e-446e-88ce-51a576b7440c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.810442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c314-617e-446e-88ce-51a576b7440c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.868155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35df3b-9588-45a9-a1af-ad9cdeec5ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.868751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35df3b-9588-45a9-a1af-ad9cdeec5ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.869032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35df3b-9588-45a9-a1af-ad9cdeec5ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.869300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35df3b-9588-45a9-a1af-ad9cdeec5ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.869914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35df3b-9588-45a9-a1af-ad9cdeec5ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.871821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35df3b-9588-45a9-a1af-ad9cdeec5ab6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.893002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1269/2546] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:11:27 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:27.896961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fea83c-440f-45ae-b24f-b9b2edae86e0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.907993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fea83c-440f-45ae-b24f-b9b2edae86e0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.912851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b6923-7bb7-4fca-84dd-d28b0cfd8231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.913445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6923-7bb7-4fca-84dd-d28b0cfd8231 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.913726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6923-7bb7-4fca-84dd-d28b0cfd8231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.914005 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6923-7bb7-4fca-84dd-d28b0cfd8231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.914735 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b6923-7bb7-4fca-84dd-d28b0cfd8231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.916235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b6923-7bb7-4fca-84dd-d28b0cfd8231 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.927229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1278/2547] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:27.931351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35df3b-9588-45a9-a1af-ad9cdeec5ab6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.941522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35df3b-9588-45a9-a1af-ad9cdeec5ab6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.946131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cfa0b-6260-4c87-a624-8266854c68c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.946920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfa0b-6260-4c87-a624-8266854c68c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.947204 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfa0b-6260-4c87-a624-8266854c68c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.947488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfa0b-6260-4c87-a624-8266854c68c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.948112 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cfa0b-6260-4c87-a624-8266854c68c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.950751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cfa0b-6260-4c87-a624-8266854c68c6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:27.960824 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1270/2548] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:27.964756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b6923-7bb7-4fca-84dd-d28b0cfd8231 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:27.975675 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b6923-7bb7-4fca-84dd-d28b0cfd8231 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:27.980186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5616c-b6a6-45d4-b2ce-6e6d3d968db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:27.980904 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5616c-b6a6-45d4-b2ce-6e6d3d968db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:27.982772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5616c-b6a6-45d4-b2ce-6e6d3d968db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:27.983055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5616c-b6a6-45d4-b2ce-6e6d3d968db2 admin admin] PATH_INFO: `/v3/projects/dec212ee51bf4d91bf47cfe0153ee46f/users/e4d26780991b40a795efe797bef3fae0/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:27.997237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5616c-b6a6-45d4-b2ce-6e6d3d968db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec212ee51bf4d91bf47cfe0153ee46f, user_id=e4d26780991b40a795efe797bef3fae0, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:27.999861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5616c-b6a6-45d4-b2ce-6e6d3d968db2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:28.013364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1279/2549] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:27 2022] PUT /identity/v3/projects/dec212ee51bf4d91bf47cfe0153ee46f/users/e4d26780991b40a795efe797bef3fae0/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:28.023798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1669ce-3206-4e9d-9117-31e81d76957a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:28.024175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1669ce-3206-4e9d-9117-31e81d76957a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:28.024521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1669ce-3206-4e9d-9117-31e81d76957a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:28.061816 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7e1669ce-3206-4e9d-9117-31e81d76957a None None] MFA Rules not processed for user `e4d26780991b40a795efe797bef3fae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:28.063041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7e1669ce-3206-4e9d-9117-31e81d76957a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:28.132574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1271/2550] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:28.137063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5616c-b6a6-45d4-b2ce-6e6d3d968db2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:28.146813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:28.203989 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5616c-b6a6-45d4-b2ce-6e6d3d968db2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:28.208852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfb821-69be-4904-b745-0b3c7ee80bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:28.209460 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb821-69be-4904-b745-0b3c7ee80bda admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:28.209733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb821-69be-4904-b745-0b3c7ee80bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:28.210011 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfb821-69be-4904-b745-0b3c7ee80bda admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:28.210645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfb821-69be-4904-b745-0b3c7ee80bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:28.212590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfb821-69be-4904-b745-0b3c7ee80bda admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:28.243591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1280/2551] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:11:28 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:11:28.248564 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1669ce-3206-4e9d-9117-31e81d76957a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:28.259722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1669ce-3206-4e9d-9117-31e81d76957a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:28.265659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:28.330602 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5dcf9-bd6c-43e0-bdf7-70a55f93dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:28.331424 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5dcf9-bd6c-43e0-bdf7-70a55f93dea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:28.331770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5dcf9-bd6c-43e0-bdf7-70a55f93dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:28.332108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5dcf9-bd6c-43e0-bdf7-70a55f93dea9 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:28.332839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5dcf9-bd6c-43e0-bdf7-70a55f93dea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:28.335407 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5dcf9-bd6c-43e0-bdf7-70a55f93dea9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:28.356757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1272/2552] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:11:28 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:11:28.360871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfb821-69be-4904-b745-0b3c7ee80bda admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:28.373768 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfb821-69be-4904-b745-0b3c7ee80bda admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:28.378516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369917c-912e-4c32-9165-92a1510c53dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:28.379116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369917c-912e-4c32-9165-92a1510c53dc admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:28.379398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369917c-912e-4c32-9165-92a1510c53dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:28.379669 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369917c-912e-4c32-9165-92a1510c53dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:28.380305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369917c-912e-4c32-9165-92a1510c53dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:28.381933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369917c-912e-4c32-9165-92a1510c53dc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:28.393301 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1281/2553] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:11:28.397517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5dcf9-bd6c-43e0-bdf7-70a55f93dea9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:28.407468 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5dcf9-bd6c-43e0-bdf7-70a55f93dea9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:28.411957 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f20c4-3292-491b-97b7-10321fa51b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:28.412641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f20c4-3292-491b-97b7-10321fa51b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:28.412920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f20c4-3292-491b-97b7-10321fa51b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:28.413194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f20c4-3292-491b-97b7-10321fa51b7a admin admin] PATH_INFO: `/v3/projects/e5403b0fabed4a85a0a853c8812785ee/users/7870aeea1ea344f980be37f8ed5a996c/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:28.427796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f20c4-3292-491b-97b7-10321fa51b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5403b0fabed4a85a0a853c8812785ee, user_id=7870aeea1ea344f980be37f8ed5a996c, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:28.430438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f20c4-3292-491b-97b7-10321fa51b7a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:28.443461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1273/2554] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:28 2022] PUT /identity/v3/projects/e5403b0fabed4a85a0a853c8812785ee/users/7870aeea1ea344f980be37f8ed5a996c/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:11:28.447528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369917c-912e-4c32-9165-92a1510c53dc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:28.458097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369917c-912e-4c32-9165-92a1510c53dc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:28.514449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2239667-4ef8-42d0-944b-81e58d127e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:28.515085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2239667-4ef8-42d0-944b-81e58d127e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:28.515364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2239667-4ef8-42d0-944b-81e58d127e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:28.515632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2239667-4ef8-42d0-944b-81e58d127e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:28.516265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2239667-4ef8-42d0-944b-81e58d127e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:28.517874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2239667-4ef8-42d0-944b-81e58d127e29 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:28.527594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1282/2555] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:28.531947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f20c4-3292-491b-97b7-10321fa51b7a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:28.542373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f20c4-3292-491b-97b7-10321fa51b7a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:28.547560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e68d4c-f883-4128-912f-004dec612ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:28.548213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e68d4c-f883-4128-912f-004dec612ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:28.548529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e68d4c-f883-4128-912f-004dec612ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:28.548811 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e68d4c-f883-4128-912f-004dec612ca9 admin admin] PATH_INFO: `/v3/projects/e5403b0fabed4a85a0a853c8812785ee/users/7870aeea1ea344f980be37f8ed5a996c/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:28.550734 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e68d4c-f883-4128-912f-004dec612ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5403b0fabed4a85a0a853c8812785ee, user_id=7870aeea1ea344f980be37f8ed5a996c, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:28.553388 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e68d4c-f883-4128-912f-004dec612ca9 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:28.564153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1274/2556] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:28 2022] PUT /identity/v3/projects/e5403b0fabed4a85a0a853c8812785ee/users/7870aeea1ea344f980be37f8ed5a996c/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:28.574392 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6d651-7375-42b2-a68e-592fd002cfb5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:28.574680 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6d651-7375-42b2-a68e-592fd002cfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:28.575050 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6d651-7375-42b2-a68e-592fd002cfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:28.602394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-13b6d651-7375-42b2-a68e-592fd002cfb5 None None] MFA Rules not processed for user `7870aeea1ea344f980be37f8ed5a996c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:28.603596 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-13b6d651-7375-42b2-a68e-592fd002cfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:28.674627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1283/2557] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:28.686827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e68d4c-f883-4128-912f-004dec612ca9 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:28.688578 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-01e68d4c-f883-4128-912f-004dec612ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:28.749497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e68d4c-f883-4128-912f-004dec612ca9 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:28.753315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a2fa7-0df2-4644-adf0-b0742244a35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:28.753920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2fa7-0df2-4644-adf0-b0742244a35e service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:28.754194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2fa7-0df2-4644-adf0-b0742244a35e service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:28.754465 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2fa7-0df2-4644-adf0-b0742244a35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:28.811063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a2fa7-0df2-4644-adf0-b0742244a35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:28.812557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a2fa7-0df2-4644-adf0-b0742244a35e service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:28.821712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1275/2558] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:30.339977 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6d651-7375-42b2-a68e-592fd002cfb5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:30.344912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:30.351428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6d651-7375-42b2-a68e-592fd002cfb5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:30.355305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1238-13da-4751-a333-7f4942b505f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:30.356396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1238-13da-4751-a333-7f4942b505f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:30.356721 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1238-13da-4751-a333-7f4942b505f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:30.356995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1238-13da-4751-a333-7f4942b505f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:30.412905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae1238-13da-4751-a333-7f4942b505f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:30.414342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae1238-13da-4751-a333-7f4942b505f2 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:30.423872 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1284/2559] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:30.935935 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a2fa7-0df2-4644-adf0-b0742244a35e service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:30.944574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a2fa7-0df2-4644-adf0-b0742244a35e service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:30.948252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a87eb1-3ea1-43f5-80ba-8bdf1980627a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:30.948906 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87eb1-3ea1-43f5-80ba-8bdf1980627a service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:30.949187 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87eb1-3ea1-43f5-80ba-8bdf1980627a service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:30.949467 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87eb1-3ea1-43f5-80ba-8bdf1980627a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:30.958520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a87eb1-3ea1-43f5-80ba-8bdf1980627a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:30.959976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a87eb1-3ea1-43f5-80ba-8bdf1980627a service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:30.969793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1276/2560] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:34.834483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1238-13da-4751-a333-7f4942b505f2 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:34.897365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1238-13da-4751-a333-7f4942b505f2 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:34.901882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:34.902512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:34.902810 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:34.903091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] PATH_INFO: `/v3/users/0a8e2ad5a8c04249b5bb6b3dab9b5446` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:34.904249 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8e2ad5a8c04249b5bb6b3dab9b5446)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:34.906192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:34.953438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8e2ad5a8c04249b5bb6b3dab9b5446'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:34.954103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8e2ad5a8c04249b5bb6b3dab9b5446'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:34.965674 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8e2ad5a8c04249b5bb6b3dab9b5446'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:34.972622 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8e2ad5a8c04249b5bb6b3dab9b5446'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:34.973253 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8e2ad5a8c04249b5bb6b3dab9b5446'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:34.986118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1285/2561] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:11:34 2022] DELETE /identity/v3/users/0a8e2ad5a8c04249b5bb6b3dab9b5446 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:34.990726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995bcaf-ec2a-45f2-a910-43b3495df7a6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:34.991203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995bcaf-ec2a-45f2-a910-43b3495df7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:34.991203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995bcaf-ec2a-45f2-a910-43b3495df7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:34.998625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:35.011621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b995bcaf-ec2a-45f2-a910-43b3495df7a6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:35.012909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b995bcaf-ec2a-45f2-a910-43b3495df7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:35.078044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1277/2562] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:35.087864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:35.089517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:35.111951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:35.149760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85345938-443b-4863-a407-93e3a1c8446a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:35.153438 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2280cf-793a-445e-b60c-92cd43219cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:35.154078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2280cf-793a-445e-b60c-92cd43219cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:35.154362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2280cf-793a-445e-b60c-92cd43219cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:35.154640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2280cf-793a-445e-b60c-92cd43219cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:35.163436 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2280cf-793a-445e-b60c-92cd43219cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:35.164926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2280cf-793a-445e-b60c-92cd43219cb4 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:35.174181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1286/2563] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:35.453706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995bcaf-ec2a-45f2-a910-43b3495df7a6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:35.455263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b995bcaf-ec2a-45f2-a910-43b3495df7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:35.467969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995bcaf-ec2a-45f2-a910-43b3495df7a6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:35.472617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:35.473259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:35.473542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:35.473878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] PATH_INFO: `/v3/projects/4012aa1f8def4121b868844a8c62e006` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:35.475003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4012aa1f8def4121b868844a8c62e006)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:35.476962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:35.524938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4012aa1f8def4121b868844a8c62e006', 'request_id': 'req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:35.531736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4012aa1f8def4121b868844a8c62e006', 'request_id': 'req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:35.539728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4012aa1f8def4121b868844a8c62e006', 'request_id': 'req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:35.549776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] The token cache is being invalidate because project 4012aa1f8def4121b868844a8c62e006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:11:35.550062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:35.550669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:35.552130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1278/2564] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:11:35 2022] DELETE /identity/v3/projects/4012aa1f8def4121b868844a8c62e006 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:35.556135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2280cf-793a-445e-b60c-92cd43219cb4 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:35.565947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2280cf-793a-445e-b60c-92cd43219cb4 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:35.622377 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:35.623520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:35.623809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:35.624082 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] PATH_INFO: `/v3/users/e4d26780991b40a795efe797bef3fae0` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:35.625636 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d26780991b40a795efe797bef3fae0)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:35.627654 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:35.673749 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d26780991b40a795efe797bef3fae0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:35.674402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d26780991b40a795efe797bef3fae0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:35.686621 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d26780991b40a795efe797bef3fae0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:35.693478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d26780991b40a795efe797bef3fae0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:35.694148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d26780991b40a795efe797bef3fae0'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:35.707097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1287/2565] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:11:35 2022] DELETE /identity/v3/users/e4d26780991b40a795efe797bef3fae0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:11:35.993221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:35.995067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:36.012491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec3ad2-9b4c-4008-bbc2-df603bb4b713 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:36.078223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:36.078865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:36.079141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:36.079416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] PATH_INFO: `/v3/projects/dec212ee51bf4d91bf47cfe0153ee46f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:36.080556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec212ee51bf4d91bf47cfe0153ee46f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:36.082474 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:36.117607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:36.141744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec212ee51bf4d91bf47cfe0153ee46f', 'request_id': 'req-acaa4730-6b39-4329-a79b-27c54c2e3b66'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.148076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec212ee51bf4d91bf47cfe0153ee46f', 'request_id': 'req-acaa4730-6b39-4329-a79b-27c54c2e3b66'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.155511 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec212ee51bf4d91bf47cfe0153ee46f', 'request_id': 'req-acaa4730-6b39-4329-a79b-27c54c2e3b66'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.165917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] The token cache is being invalidate because project dec212ee51bf4d91bf47cfe0153ee46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:11:36.166250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.166916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.168413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1279/2566] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:11:35 2022] DELETE /identity/v3/projects/dec212ee51bf4d91bf47cfe0153ee46f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:36.178248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:36.179800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:36.193517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e2d4-ca77-448b-aaf0-1f02d61a98d0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:36.232770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:36.251485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:36.252120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:36.252403 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:36.252707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] PATH_INFO: `/v3/users/7870aeea1ea344f980be37f8ed5a996c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:36.253826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7870aeea1ea344f980be37f8ed5a996c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:36.255759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:36.304144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7870aeea1ea344f980be37f8ed5a996c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.304952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7870aeea1ea344f980be37f8ed5a996c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.317432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7870aeea1ea344f980be37f8ed5a996c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.324857 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7870aeea1ea344f980be37f8ed5a996c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.325657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1c2ff5d3-a371-4cf7-a6ee-c5475db3d286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7870aeea1ea344f980be37f8ed5a996c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.343760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1288/2567] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:11:36 2022] DELETE /identity/v3/users/7870aeea1ea344f980be37f8ed5a996c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:36.618270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:36.619810 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:36.632709 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa4730-6b39-4329-a79b-27c54c2e3b66 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:36.691472 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:36.692121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:36.693363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:36.693363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] PATH_INFO: `/v3/projects/e5403b0fabed4a85a0a853c8812785ee` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:36.693821 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5403b0fabed4a85a0a853c8812785ee)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:36.695720 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:36.743893 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5403b0fabed4a85a0a853c8812785ee', 'request_id': 'req-b6caac07-39f2-49d4-b073-a0063e56ee90'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.750151 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5403b0fabed4a85a0a853c8812785ee', 'request_id': 'req-b6caac07-39f2-49d4-b073-a0063e56ee90'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.757682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5403b0fabed4a85a0a853c8812785ee', 'request_id': 'req-b6caac07-39f2-49d4-b073-a0063e56ee90'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.769060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] The token cache is being invalidate because project e5403b0fabed4a85a0a853c8812785ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:11:36.769345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.769975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b6caac07-39f2-49d4-b073-a0063e56ee90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:36.771452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1280/2568] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:11:36 2022] DELETE /identity/v3/projects/e5403b0fabed4a85a0a853c8812785ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:36.777119 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19f2af-5179-4739-8ace-0e21363e5604 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:36.777405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19f2af-5179-4739-8ace-0e21363e5604 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:36.777702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19f2af-5179-4739-8ace-0e21363e5604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:36.799666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4b19f2af-5179-4739-8ace-0e21363e5604 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:36.800894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4b19f2af-5179-4739-8ace-0e21363e5604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:36.858785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1289/2569] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:36.866644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c6d1a-b8c3-4fea-a364-a918137fe38a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:36.866877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c6d1a-b8c3-4fea-a364-a918137fe38a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:36.867148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c6d1a-b8c3-4fea-a364-a918137fe38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:36.886268 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-644c6d1a-b8c3-4fea-a364-a918137fe38a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:36.887452 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-644c6d1a-b8c3-4fea-a364-a918137fe38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:36.895781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1281/2570] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:36.899989 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19f2af-5179-4739-8ace-0e21363e5604 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:36.910953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19f2af-5179-4739-8ace-0e21363e5604 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:36.915551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661d326-2c27-4222-b9b7-4d2f74e264d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:36.916145 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d326-2c27-4222-b9b7-4d2f74e264d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:36.916427 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d326-2c27-4222-b9b7-4d2f74e264d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:36.916739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d326-2c27-4222-b9b7-4d2f74e264d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:36.917383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661d326-2c27-4222-b9b7-4d2f74e264d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:11:36.917686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661d326-2c27-4222-b9b7-4d2f74e264d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:36.919260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661d326-2c27-4222-b9b7-4d2f74e264d0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:36.930657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1290/2571] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:11:36.935196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c6d1a-b8c3-4fea-a364-a918137fe38a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:36.944537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c6d1a-b8c3-4fea-a364-a918137fe38a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:36.949275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9244b3e-d9e4-4b7e-ab4b-5b2112adbb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:36.949873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9244b3e-d9e4-4b7e-ab4b-5b2112adbb66 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:36.950153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9244b3e-d9e4-4b7e-ab4b-5b2112adbb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:36.950426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9244b3e-d9e4-4b7e-ab4b-5b2112adbb66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:36.951572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9244b3e-d9e4-4b7e-ab4b-5b2112adbb66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:36.953502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9244b3e-d9e4-4b7e-ab4b-5b2112adbb66 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:36.981030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1282/2572] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:11:36 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:36.985301 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661d326-2c27-4222-b9b7-4d2f74e264d0 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:36.995226 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661d326-2c27-4222-b9b7-4d2f74e264d0 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:37.043637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:37.057229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afa43b-6654-4742-adad-33acbbcd618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:37.057839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afa43b-6654-4742-adad-33acbbcd618e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:37.058121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afa43b-6654-4742-adad-33acbbcd618e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:37.058423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afa43b-6654-4742-adad-33acbbcd618e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:37.059056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afa43b-6654-4742-adad-33acbbcd618e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:37.060991 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afa43b-6654-4742-adad-33acbbcd618e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:37.082211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1291/2573] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:11:36 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:37.086408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9244b3e-d9e4-4b7e-ab4b-5b2112adbb66 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:37.097891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9244b3e-d9e4-4b7e-ab4b-5b2112adbb66 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:37.102655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd2338-c477-43d6-b3b0-c1ac3f94a52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:37.103292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd2338-c477-43d6-b3b0-c1ac3f94a52f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:37.103595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd2338-c477-43d6-b3b0-c1ac3f94a52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:37.103864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd2338-c477-43d6-b3b0-c1ac3f94a52f admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:37.104536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd2338-c477-43d6-b3b0-c1ac3f94a52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:37.106126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd2338-c477-43d6-b3b0-c1ac3f94a52f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:37.116249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1283/2574] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:37.120365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afa43b-6654-4742-adad-33acbbcd618e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:37.131554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afa43b-6654-4742-adad-33acbbcd618e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:37.136169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bc2bb-ec9a-4836-943b-6e1fe8d7fa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:37.136808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc2bb-ec9a-4836-943b-6e1fe8d7fa1b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:37.137095 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc2bb-ec9a-4836-943b-6e1fe8d7fa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:37.137383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc2bb-ec9a-4836-943b-6e1fe8d7fa1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:37.138112 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bc2bb-ec9a-4836-943b-6e1fe8d7fa1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:37.140326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bc2bb-ec9a-4836-943b-6e1fe8d7fa1b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:37.151912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1292/2575] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:37.156086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd2338-c477-43d6-b3b0-c1ac3f94a52f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:37.166010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd2338-c477-43d6-b3b0-c1ac3f94a52f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:37.170585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15946b03-2d21-4c6c-b17a-843199aec5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:37.171242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15946b03-2d21-4c6c-b17a-843199aec5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:37.171522 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15946b03-2d21-4c6c-b17a-843199aec5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:37.171795 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15946b03-2d21-4c6c-b17a-843199aec5e5 admin admin] PATH_INFO: `/v3/projects/85c1a93c26604805be91cc986adfece8/users/0cd3bf3839a94cfc92954fb216c1fb18/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:37.174197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:37.190868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15946b03-2d21-4c6c-b17a-843199aec5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c1a93c26604805be91cc986adfece8, user_id=0cd3bf3839a94cfc92954fb216c1fb18, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:37.193567 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15946b03-2d21-4c6c-b17a-843199aec5e5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:37.207765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1284/2576] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:37 2022] PUT /identity/v3/projects/85c1a93c26604805be91cc986adfece8/users/0cd3bf3839a94cfc92954fb216c1fb18/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:11:37.218563 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5c3c4-3ffa-4ce6-ade6-ed526615c29c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:37.219103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5c3c4-3ffa-4ce6-ade6-ed526615c29c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:37.219257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5c3c4-3ffa-4ce6-ade6-ed526615c29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:37.251598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5ea5c3c4-3ffa-4ce6-ade6-ed526615c29c None None] MFA Rules not processed for user `0cd3bf3839a94cfc92954fb216c1fb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:37.252983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5ea5c3c4-3ffa-4ce6-ade6-ed526615c29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:37.322608 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1293/2577] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:37.334271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15946b03-2d21-4c6c-b17a-843199aec5e5 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:37.336008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-15946b03-2d21-4c6c-b17a-843199aec5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:37.394105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15946b03-2d21-4c6c-b17a-843199aec5e5 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:37.397703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a26601-9c99-49cd-b424-43fde87878dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:37.398310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26601-9c99-49cd-b424-43fde87878dc service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:37.398589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26601-9c99-49cd-b424-43fde87878dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:37.398861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26601-9c99-49cd-b424-43fde87878dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:37.407298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a26601-9c99-49cd-b424-43fde87878dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:37.408967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a26601-9c99-49cd-b424-43fde87878dc service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:37.417754 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1285/2578] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:37.443039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5c3c4-3ffa-4ce6-ade6-ed526615c29c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:37.506771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5c3c4-3ffa-4ce6-ade6-ed526615c29c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:37.511406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:37.512053 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:37.512319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:37.512627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] PATH_INFO: `/v3/users/0cd3bf3839a94cfc92954fb216c1fb18` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:37.514331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd3bf3839a94cfc92954fb216c1fb18)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:37.516332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:37.563430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd3bf3839a94cfc92954fb216c1fb18'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:37.564110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd3bf3839a94cfc92954fb216c1fb18'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:37.571932 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:37.580149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd3bf3839a94cfc92954fb216c1fb18'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:37.589665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd3bf3839a94cfc92954fb216c1fb18'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:37.590442 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd3bf3839a94cfc92954fb216c1fb18'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:37.603663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1294/2579] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:11:37 2022] DELETE /identity/v3/users/0cd3bf3839a94cfc92954fb216c1fb18 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:37.609409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b377f-7e70-4c21-b417-8f9106bca398 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:37.609699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b377f-7e70-4c21-b417-8f9106bca398 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:37.609993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b377f-7e70-4c21-b417-8f9106bca398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:37.630300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a74b377f-7e70-4c21-b417-8f9106bca398 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:37.631513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a74b377f-7e70-4c21-b417-8f9106bca398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:37.698865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1286/2580] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:11:37.708725 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:37.710183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:37.770068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a76baf-b2d3-4c1b-81b8-cb754b33c6e6 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:37.775088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967101c-25cc-4bf3-9d86-54b7f24de319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:37.775702 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967101c-25cc-4bf3-9d86-54b7f24de319 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:37.775983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967101c-25cc-4bf3-9d86-54b7f24de319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:37.776260 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967101c-25cc-4bf3-9d86-54b7f24de319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:37.785299 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967101c-25cc-4bf3-9d86-54b7f24de319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:37.786726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967101c-25cc-4bf3-9d86-54b7f24de319 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:37.796938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1295/2581] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:38.057766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b377f-7e70-4c21-b417-8f9106bca398 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:38.059235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a74b377f-7e70-4c21-b417-8f9106bca398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:38.071278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b377f-7e70-4c21-b417-8f9106bca398 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:38.075887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:38.076552 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.076837 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.077114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] PATH_INFO: `/v3/projects/85c1a93c26604805be91cc986adfece8` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.078246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c1a93c26604805be91cc986adfece8)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:38.080155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:38.129777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c1a93c26604805be91cc986adfece8', 'request_id': 'req-c31dfa7a-8561-45cf-8841-8b26dab1d488'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:38.135914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c1a93c26604805be91cc986adfece8', 'request_id': 'req-c31dfa7a-8561-45cf-8841-8b26dab1d488'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:38.144394 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c1a93c26604805be91cc986adfece8', 'request_id': 'req-c31dfa7a-8561-45cf-8841-8b26dab1d488'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:38.156308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] The token cache is being invalidate because project 85c1a93c26604805be91cc986adfece8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:11:38.156743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:38.157588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c31dfa7a-8561-45cf-8841-8b26dab1d488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:38.159571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1287/2582] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:11:38 2022] DELETE /identity/v3/projects/85c1a93c26604805be91cc986adfece8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:38.164810 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71b74-1ac5-44ef-b650-f99057325492 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.165097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71b74-1ac5-44ef-b650-f99057325492 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.165375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71b74-1ac5-44ef-b650-f99057325492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.185191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-27e71b74-1ac5-44ef-b650-f99057325492 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:38.186400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-27e71b74-1ac5-44ef-b650-f99057325492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:38.245077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1296/2583] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:11:38.309706 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83efc9-afc2-4d56-b5c0-ce3a9c8b7e47 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.310038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83efc9-afc2-4d56-b5c0-ce3a9c8b7e47 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.310320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83efc9-afc2-4d56-b5c0-ce3a9c8b7e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.330579 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ad83efc9-afc2-4d56-b5c0-ce3a9c8b7e47 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:38.331796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ad83efc9-afc2-4d56-b5c0-ce3a9c8b7e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:38.339846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1288/2584] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:38.344803 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e71b74-1ac5-44ef-b650-f99057325492 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:38.354707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e71b74-1ac5-44ef-b650-f99057325492 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:38.359562 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3c283-f726-4fe0-82f2-ff25ec12cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:38.360274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c283-f726-4fe0-82f2-ff25ec12cc11 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.360645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c283-f726-4fe0-82f2-ff25ec12cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.360996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c283-f726-4fe0-82f2-ff25ec12cc11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.361662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3c283-f726-4fe0-82f2-ff25ec12cc11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:11:38.361975 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3c283-f726-4fe0-82f2-ff25ec12cc11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:38.363626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3c283-f726-4fe0-82f2-ff25ec12cc11 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:38.375979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1297/2585] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:11:38.380446 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83efc9-afc2-4d56-b5c0-ce3a9c8b7e47 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:38.384908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:38.393143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83efc9-afc2-4d56-b5c0-ce3a9c8b7e47 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:38.399855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82debe-6033-4ffb-927b-fc578de47f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:38.400483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82debe-6033-4ffb-927b-fc578de47f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.400783 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82debe-6033-4ffb-927b-fc578de47f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.401054 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82debe-6033-4ffb-927b-fc578de47f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.401682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82debe-6033-4ffb-927b-fc578de47f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:38.403580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82debe-6033-4ffb-927b-fc578de47f37 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:38.436313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1289/2586] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:11:38 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:11:38.437743 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3c283-f726-4fe0-82f2-ff25ec12cc11 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:38.448489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3c283-f726-4fe0-82f2-ff25ec12cc11 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:38.510540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ab1b8-3b33-471f-ada0-e0d3026cc03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:38.511153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ab1b8-3b33-471f-ada0-e0d3026cc03e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.511429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ab1b8-3b33-471f-ada0-e0d3026cc03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.511701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ab1b8-3b33-471f-ada0-e0d3026cc03e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.512334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ab1b8-3b33-471f-ada0-e0d3026cc03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:38.514313 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ab1b8-3b33-471f-ada0-e0d3026cc03e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:38.524964 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:38.536561 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1298/2587] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:11:38 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:11:38.540750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82debe-6033-4ffb-927b-fc578de47f37 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:38.551555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82debe-6033-4ffb-927b-fc578de47f37 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:38.556589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa187b-9518-4f1e-8d1d-9ccd504cc36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:38.557220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa187b-9518-4f1e-8d1d-9ccd504cc36f admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.557485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa187b-9518-4f1e-8d1d-9ccd504cc36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.557762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa187b-9518-4f1e-8d1d-9ccd504cc36f admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.558404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa187b-9518-4f1e-8d1d-9ccd504cc36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:38.560679 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa187b-9518-4f1e-8d1d-9ccd504cc36f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:38.570685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1290/2588] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:38.574748 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ab1b8-3b33-471f-ada0-e0d3026cc03e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:38.584677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ab1b8-3b33-471f-ada0-e0d3026cc03e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:38.589813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c5a83-e226-4151-8df9-94305ef3322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:38.590367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5a83-e226-4151-8df9-94305ef3322e admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.590644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5a83-e226-4151-8df9-94305ef3322e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.590918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5a83-e226-4151-8df9-94305ef3322e admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.591869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c5a83-e226-4151-8df9-94305ef3322e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:38.593493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c5a83-e226-4151-8df9-94305ef3322e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:38.604025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1299/2589] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:11:38.608864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa187b-9518-4f1e-8d1d-9ccd504cc36f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:38.618952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa187b-9518-4f1e-8d1d-9ccd504cc36f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:38.624103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e896056-ef88-4500-b748-9655764bd206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:38.624797 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e896056-ef88-4500-b748-9655764bd206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.625081 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e896056-ef88-4500-b748-9655764bd206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.625356 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e896056-ef88-4500-b748-9655764bd206 admin admin] PATH_INFO: `/v3/projects/dd92dac676a64a67a913b30d399c9d76/users/28a09e48e0f34f288b211cb5c0ddf4d1/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.639680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e896056-ef88-4500-b748-9655764bd206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd92dac676a64a67a913b30d399c9d76, user_id=28a09e48e0f34f288b211cb5c0ddf4d1, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:38.642355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e896056-ef88-4500-b748-9655764bd206 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:38.655741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1291/2590] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:11:38 2022] PUT /identity/v3/projects/dd92dac676a64a67a913b30d399c9d76/users/28a09e48e0f34f288b211cb5c0ddf4d1/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:38.665811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905286a2-df8d-45cd-88ea-5f10c7bab410 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.666098 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905286a2-df8d-45cd-88ea-5f10c7bab410 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.666381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905286a2-df8d-45cd-88ea-5f10c7bab410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.693701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-905286a2-df8d-45cd-88ea-5f10c7bab410 None None] MFA Rules not processed for user `28a09e48e0f34f288b211cb5c0ddf4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:38.694915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-905286a2-df8d-45cd-88ea-5f10c7bab410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:38.763657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1300/2591] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:38.774122 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e896056-ef88-4500-b748-9655764bd206 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:38.775772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7e896056-ef88-4500-b748-9655764bd206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:38.832295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e896056-ef88-4500-b748-9655764bd206 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:38.835924 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867900c1-789a-44a9-8225-b2e4dba5a2cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:38.836547 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867900c1-789a-44a9-8225-b2e4dba5a2cd service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:38.836828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867900c1-789a-44a9-8225-b2e4dba5a2cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:38.837104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867900c1-789a-44a9-8225-b2e4dba5a2cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:38.846198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867900c1-789a-44a9-8225-b2e4dba5a2cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:38.847618 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867900c1-789a-44a9-8225-b2e4dba5a2cd service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:38.856328 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1292/2592] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:48.505068 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6070a8-bb3b-4a74-a5ea-cb3c4bdad8a4 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:48.505582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6070a8-bb3b-4a74-a5ea-cb3c4bdad8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:48.505671 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6070a8-bb3b-4a74-a5ea-cb3c4bdad8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:48.524690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4e6070a8-bb3b-4a74-a5ea-cb3c4bdad8a4 None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:48.526401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4e6070a8-bb3b-4a74-a5ea-cb3c4bdad8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:48.582143 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1301/2593] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:11:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:11:48.630965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867900c1-789a-44a9-8225-b2e4dba5a2cd service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:48.632412 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-867900c1-789a-44a9-8225-b2e4dba5a2cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:48.701410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867900c1-789a-44a9-8225-b2e4dba5a2cd service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:48.706360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dd7b6-c906-42ea-8714-5fc894e92be7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:48.706974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd7b6-c906-42ea-8714-5fc894e92be7 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:48.707281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd7b6-c906-42ea-8714-5fc894e92be7 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:48.707555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd7b6-c906-42ea-8714-5fc894e92be7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:48.715753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36dd7b6-c906-42ea-8714-5fc894e92be7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:48.718150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36dd7b6-c906-42ea-8714-5fc894e92be7 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:48.726626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1293/2594] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:11:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:11:49.030000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6070a8-bb3b-4a74-a5ea-cb3c4bdad8a4 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:49.131289 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6070a8-bb3b-4a74-a5ea-cb3c4bdad8a4 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:49.136116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:49.136776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:49.137056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:49.137462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] PATH_INFO: `/v3/users/28a09e48e0f34f288b211cb5c0ddf4d1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:49.141220 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a09e48e0f34f288b211cb5c0ddf4d1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:49.144040 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:49.170097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:49.204390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a09e48e0f34f288b211cb5c0ddf4d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:49.205000 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a09e48e0f34f288b211cb5c0ddf4d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:49.219918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a09e48e0f34f288b211cb5c0ddf4d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:49.227627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a09e48e0f34f288b211cb5c0ddf4d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:49.228325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a09e48e0f34f288b211cb5c0ddf4d1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:49.245378 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1302/2595] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:11:49 2022] DELETE /identity/v3/users/28a09e48e0f34f288b211cb5c0ddf4d1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:49.247959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb34d9-bdef-4eaf-a7c2-e950e9878337 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:49.248249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb34d9-bdef-4eaf-a7c2-e950e9878337 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:49.248553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb34d9-bdef-4eaf-a7c2-e950e9878337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:49.269355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-23bb34d9-bdef-4eaf-a7c2-e950e9878337 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:11:49.270629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-23bb34d9-bdef-4eaf-a7c2-e950e9878337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:49.305390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:49.336667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1294/2596] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:11:49.346481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:49.348038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:49.413954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937bee9-ff46-40bb-a2a8-3f880aac9f5e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:49.420331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2829c1-e658-40a5-9904-a8a6c60885d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:49.421060 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2829c1-e658-40a5-9904-a8a6c60885d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:49.421409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2829c1-e658-40a5-9904-a8a6c60885d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:49.421687 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2829c1-e658-40a5-9904-a8a6c60885d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:49.435833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2829c1-e658-40a5-9904-a8a6c60885d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:49.437309 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2829c1-e658-40a5-9904-a8a6c60885d5 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:49.449427 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1303/2597] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:11:49.762868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb34d9-bdef-4eaf-a7c2-e950e9878337 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:11:49.764392 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-23bb34d9-bdef-4eaf-a7c2-e950e9878337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:11:49.780230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb34d9-bdef-4eaf-a7c2-e950e9878337 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:11:49.785125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:11:49.785845 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:11:49.786200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:11:49.786692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] PATH_INFO: `/v3/projects/dd92dac676a64a67a913b30d399c9d76` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:11:49.788780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd92dac676a64a67a913b30d399c9d76)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:11:49.790915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:11:49.849637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd92dac676a64a67a913b30d399c9d76', 'request_id': 'req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:49.858748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd92dac676a64a67a913b30d399c9d76', 'request_id': 'req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:49.867072 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd92dac676a64a67a913b30d399c9d76', 'request_id': 'req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:49.881360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] The token cache is being invalidate because project dd92dac676a64a67a913b30d399c9d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:11:49.881785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:49.882530 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b35c33a6-d5f1-47f4-90c0-10d86432bfaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:11:49.884495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1295/2598] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:11:49 2022] DELETE /identity/v3/projects/dd92dac676a64a67a913b30d399c9d76 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:11:59.444567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:DELETE=7,keystone:SELECT=46,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:59.877281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:03.202783 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80151ec8-1803-4d14-9baf-ff566b147fcd None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:03.203406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80151ec8-1803-4d14-9baf-ff566b147fcd None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:03.203942 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80151ec8-1803-4d14-9baf-ff566b147fcd None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:03.205339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1304/2599] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:12:03.211523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232623-7b7a-4ad1-9fa0-37d7416eb016 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:03.212042 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232623-7b7a-4ad1-9fa0-37d7416eb016 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:03.212143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232623-7b7a-4ad1-9fa0-37d7416eb016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:03.274973 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b0232623-7b7a-4ad1-9fa0-37d7416eb016 None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:12:03.276172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b0232623-7b7a-4ad1-9fa0-37d7416eb016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:03.401788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1296/2600] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:12:03.413357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80151ec8-1803-4d14-9baf-ff566b147fcd None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:03.415050 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-80151ec8-1803-4d14-9baf-ff566b147fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:03.475694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80151ec8-1803-4d14-9baf-ff566b147fcd None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:03.479186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296b10c-7eeb-4ad8-af63-fdfa46c05db9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a710cfeadd004a8bbf932f6bb3b211e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:03.479797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296b10c-7eeb-4ad8-af63-fdfa46c05db9 service glance] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:03.480076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296b10c-7eeb-4ad8-af63-fdfa46c05db9 service glance] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:03.480348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296b10c-7eeb-4ad8-af63-fdfa46c05db9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:03.491816 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296b10c-7eeb-4ad8-af63-fdfa46c05db9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:03.494924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296b10c-7eeb-4ad8-af63-fdfa46c05db9 service glance] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:03.504510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1305/2601] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:12:03.574107 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b0d33-dd51-4f2e-a188-e8830cfc4100 None None] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:03.574400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b0d33-dd51-4f2e-a188-e8830cfc4100 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:03.574674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b0d33-dd51-4f2e-a188-e8830cfc4100 None None] PATH_INFO: `/` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:03.576046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1297/2602] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 17:12:03.580985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbf1a8-00eb-4391-bc28-e701f4df0337 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:03.581272 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbf1a8-00eb-4391-bc28-e701f4df0337 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:03.581547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbf1a8-00eb-4391-bc28-e701f4df0337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:03.601526 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-90bbf1a8-00eb-4391-bc28-e701f4df0337 None None] MFA Rules not processed for user `7b1fde904acd460899d8c736f5762056`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:12:03.602758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-90bbf1a8-00eb-4391-bc28-e701f4df0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:03.652955 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1306/2603] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:12:03.665288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b0d33-dd51-4f2e-a188-e8830cfc4100 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:03.667006 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-fc1b0d33-dd51-4f2e-a188-e8830cfc4100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:03.680788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b0d33-dd51-4f2e-a188-e8830cfc4100 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:03.684270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e0108-d114-49a5-9f3b-fb0aa093d67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:03.684901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e0108-d114-49a5-9f3b-fb0aa093d67b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:03.685180 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e0108-d114-49a5-9f3b-fb0aa093d67b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:03.685451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e0108-d114-49a5-9f3b-fb0aa093d67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:03.692517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e0108-d114-49a5-9f3b-fb0aa093d67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:03.693963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e0108-d114-49a5-9f3b-fb0aa093d67b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:03.702506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1298/2604] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:12:03.783891 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca269d-d4b7-48e2-92c0-b0b2920a25ae None None] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:03.784184 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca269d-d4b7-48e2-92c0-b0b2920a25ae None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:03.784483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca269d-d4b7-48e2-92c0-b0b2920a25ae None None] PATH_INFO: `/` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:03.785880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1307/2605] 10.222.0.81 () {54 vars in 921 bytes} [Thu Aug 18 17:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 17:12:03.790721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb2d46-686a-4519-90a8-054ce2d608b5 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:03.790998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb2d46-686a-4519-90a8-054ce2d608b5 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:03.791280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb2d46-686a-4519-90a8-054ce2d608b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:03.810902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1edb2d46-686a-4519-90a8-054ce2d608b5 None None] MFA Rules not processed for user `c425b390c8dc4d799270fdd095be78b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:12:03.812103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1edb2d46-686a-4519-90a8-054ce2d608b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:03.821188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1299/2606] 10.222.0.81 () {58 vars in 1018 bytes} [Thu Aug 18 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:12:03.832130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca269d-d4b7-48e2-92c0-b0b2920a25ae None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:03.843951 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca269d-d4b7-48e2-92c0-b0b2920a25ae None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:03.847751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308535-301f-49c3-9112-719f8d09e7a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:03.848350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308535-301f-49c3-9112-719f8d09e7a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:03.848689 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308535-301f-49c3-9112-719f8d09e7a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:03.848970 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308535-301f-49c3-9112-719f8d09e7a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:03.859136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40308535-301f-49c3-9112-719f8d09e7a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:03.860606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40308535-301f-49c3-9112-719f8d09e7a2 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:03.871355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1308/2607] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:12:05.443071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7206de5-a085-4412-b796-8b16575ee0c6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:05.443554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7206de5-a085-4412-b796-8b16575ee0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:05.443650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7206de5-a085-4412-b796-8b16575ee0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:05.463941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f7206de5-a085-4412-b796-8b16575ee0c6 None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:12:05.465172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f7206de5-a085-4412-b796-8b16575ee0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:05.499404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:05.522583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1300/2608] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:12:05.535319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308535-301f-49c3-9112-719f8d09e7a2 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:05.536839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-40308535-301f-49c3-9112-719f8d09e7a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:05.608571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308535-301f-49c3-9112-719f8d09e7a2 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:05.614178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4be0c5-168b-4b20-ae6a-544dacdab349 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:05.614799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4be0c5-168b-4b20-ae6a-544dacdab349 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:05.615079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4be0c5-168b-4b20-ae6a-544dacdab349 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:05.615354 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4be0c5-168b-4b20-ae6a-544dacdab349 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:05.624276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4be0c5-168b-4b20-ae6a-544dacdab349 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:05.626057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4be0c5-168b-4b20-ae6a-544dacdab349 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:05.635934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1309/2609] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:12:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:12:15.515918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:15.631408 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:21.543594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7206de5-a085-4412-b796-8b16575ee0c6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:21.545054 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f7206de5-a085-4412-b796-8b16575ee0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:21.653718 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7206de5-a085-4412-b796-8b16575ee0c6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:21.660908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b355da-e5f6-494e-a3af-5577c1854ee9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:21.661670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b355da-e5f6-494e-a3af-5577c1854ee9 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:21.662086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b355da-e5f6-494e-a3af-5577c1854ee9 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:21.662363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b355da-e5f6-494e-a3af-5577c1854ee9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:21.664391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-95b355da-e5f6-494e-a3af-5577c1854ee9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:21.678512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b355da-e5f6-494e-a3af-5577c1854ee9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:21.680230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b355da-e5f6-494e-a3af-5577c1854ee9 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:21.693156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1301/2610] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:12:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:12:25.471255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139600-cd81-4f69-b350-4a5646afb7d0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:25.471737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139600-cd81-4f69-b350-4a5646afb7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:25.471824 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139600-cd81-4f69-b350-4a5646afb7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:25.490681 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d4139600-cd81-4f69-b350-4a5646afb7d0 None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:12:25.491879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d4139600-cd81-4f69-b350-4a5646afb7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:25.499030 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1310/2611] 10.222.0.81 () {58 vars in 967 bytes} [Thu Aug 18 17:12:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:12:25.512486 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b355da-e5f6-494e-a3af-5577c1854ee9 service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:25.524363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b355da-e5f6-494e-a3af-5577c1854ee9 service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:25.529508 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2f120-957b-4eb0-adb4-5bd21445c0e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:25.530115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2f120-957b-4eb0-adb4-5bd21445c0e5 service swift] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:25.530397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2f120-957b-4eb0-adb4-5bd21445c0e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:25.530674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2f120-957b-4eb0-adb4-5bd21445c0e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:25.539581 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2f120-957b-4eb0-adb4-5bd21445c0e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:25.541203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2f120-957b-4eb0-adb4-5bd21445c0e5 service swift] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:25.550621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1302/2612] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:12:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:12:35.485947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:35.546541 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=47 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:39.675054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139600-cd81-4f69-b350-4a5646afb7d0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:39.693558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139600-cd81-4f69-b350-4a5646afb7d0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:39.697142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9250777-113c-4b56-be22-5f9634e0e66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:39.697745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9250777-113c-4b56-be22-5f9634e0e66b service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:39.698025 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9250777-113c-4b56-be22-5f9634e0e66b service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:39.698383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9250777-113c-4b56-be22-5f9634e0e66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:39.700090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f9250777-113c-4b56-be22-5f9634e0e66b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:39.785091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9250777-113c-4b56-be22-5f9634e0e66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:39.786550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9250777-113c-4b56-be22-5f9634e0e66b service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:39.806401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1311/2613] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:12:42.904074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2f120-957b-4eb0-adb4-5bd21445c0e5 service swift] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:42.906114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-66a2f120-957b-4eb0-adb4-5bd21445c0e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:42.921055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2f120-957b-4eb0-adb4-5bd21445c0e5 service swift] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:42.928962 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:42.930167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:42.930681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:42.931020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] PATH_INFO: `/v3/users/368cddc3968c4c39b7ca05c500872b45` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:42.932414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=368cddc3968c4c39b7ca05c500872b45)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:42.934647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:42.981450 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368cddc3968c4c39b7ca05c500872b45'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:12:42.989238 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368cddc3968c4c39b7ca05c500872b45'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:12:42.989846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368cddc3968c4c39b7ca05c500872b45'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:12:42.990444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368cddc3968c4c39b7ca05c500872b45'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:12:42.997334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-37701ce1-fc51-4f8e-b68f-9a597b163188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368cddc3968c4c39b7ca05c500872b45'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:12:43.014220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1303/2614] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:12:42 2022] DELETE /identity/v3/users/368cddc3968c4c39b7ca05c500872b45 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:12:43.193344 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9250777-113c-4b56-be22-5f9634e0e66b service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:43.203905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9250777-113c-4b56-be22-5f9634e0e66b service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:43.263834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:43.263834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.264283 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.264393 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] PATH_INFO: `/v3/projects/81331876bf0841e3a8de9bb649595610` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.266080 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81331876bf0841e3a8de9bb649595610)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:43.267972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:43.314066 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81331876bf0841e3a8de9bb649595610', 'request_id': 'req-7364d4b9-75a7-4304-b730-3220b4627638'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:12:43.320334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81331876bf0841e3a8de9bb649595610', 'request_id': 'req-7364d4b9-75a7-4304-b730-3220b4627638'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:12:43.322235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:43.328724 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81331876bf0841e3a8de9bb649595610', 'request_id': 'req-7364d4b9-75a7-4304-b730-3220b4627638'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:12:43.341018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] The token cache is being invalidate because project 81331876bf0841e3a8de9bb649595610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:12:43.341306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:12:43.341956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7364d4b9-75a7-4304-b730-3220b4627638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:12:43.344026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1312/2615] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:12:43 2022] DELETE /identity/v3/projects/81331876bf0841e3a8de9bb649595610 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:12:43.349161 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9089-fc8f-4a38-94af-9eb288ec40df None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.349447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9089-fc8f-4a38-94af-9eb288ec40df None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.349725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9089-fc8f-4a38-94af-9eb288ec40df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.398865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a62f9089-fc8f-4a38-94af-9eb288ec40df None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:12:43.399993 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a62f9089-fc8f-4a38-94af-9eb288ec40df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:43.464353 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1304/2616] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:12:43.472686 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbab7e-5574-4b7f-895f-2e1e0b19d871 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.472976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbab7e-5574-4b7f-895f-2e1e0b19d871 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.473259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbab7e-5574-4b7f-895f-2e1e0b19d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.492369 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-e2bbab7e-5574-4b7f-895f-2e1e0b19d871 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:12:43.493662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-e2bbab7e-5574-4b7f-895f-2e1e0b19d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:43.501945 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1313/2617] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:12:43.506235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f9089-fc8f-4a38-94af-9eb288ec40df None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:43.516703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f9089-fc8f-4a38-94af-9eb288ec40df None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:43.521337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c7a1-c4cf-4917-8ae5-2d1505212411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:43.521937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c7a1-c4cf-4917-8ae5-2d1505212411 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.522212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c7a1-c4cf-4917-8ae5-2d1505212411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.522489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c7a1-c4cf-4917-8ae5-2d1505212411 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.523131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610c7a1-c4cf-4917-8ae5-2d1505212411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:12:43.523430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610c7a1-c4cf-4917-8ae5-2d1505212411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:43.525055 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610c7a1-c4cf-4917-8ae5-2d1505212411 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:43.536740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1305/2618] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:12:43.541102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbab7e-5574-4b7f-895f-2e1e0b19d871 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:43.550444 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbab7e-5574-4b7f-895f-2e1e0b19d871 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:43.555041 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0f22-b181-4e04-a5ad-bc6a780724ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:43.555630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0f22-b181-4e04-a5ad-bc6a780724ac admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.555907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0f22-b181-4e04-a5ad-bc6a780724ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.556180 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0f22-b181-4e04-a5ad-bc6a780724ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.556899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0f22-b181-4e04-a5ad-bc6a780724ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:43.558772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0f22-b181-4e04-a5ad-bc6a780724ac admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:43.587070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1314/2619] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:12:43 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:12:43.591531 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c7a1-c4cf-4917-8ae5-2d1505212411 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:43.601548 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c7a1-c4cf-4917-8ae5-2d1505212411 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:43.634752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:43.659738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cfcab-69a8-448f-83ae-86ce013bb4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:43.660274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cfcab-69a8-448f-83ae-86ce013bb4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.660597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cfcab-69a8-448f-83ae-86ce013bb4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.660870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cfcab-69a8-448f-83ae-86ce013bb4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.661491 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cfcab-69a8-448f-83ae-86ce013bb4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:43.663384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cfcab-69a8-448f-83ae-86ce013bb4f2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:43.683874 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1306/2620] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:12:43 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:12:43.688477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0f22-b181-4e04-a5ad-bc6a780724ac admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:43.698647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0f22-b181-4e04-a5ad-bc6a780724ac admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:43.704035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c14f1-a0d9-4187-bb03-118412f0632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:43.704682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c14f1-a0d9-4187-bb03-118412f0632f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.704958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c14f1-a0d9-4187-bb03-118412f0632f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.705231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c14f1-a0d9-4187-bb03-118412f0632f admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.705869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c14f1-a0d9-4187-bb03-118412f0632f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:43.707449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c14f1-a0d9-4187-bb03-118412f0632f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:43.717540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1315/2621] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:12:43.721447 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cfcab-69a8-448f-83ae-86ce013bb4f2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:43.731572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cfcab-69a8-448f-83ae-86ce013bb4f2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:43.736354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554a6f2-290b-4375-835b-a94f90119f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:43.736996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a6f2-290b-4375-835b-a94f90119f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.737274 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a6f2-290b-4375-835b-a94f90119f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.737545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a6f2-290b-4375-835b-a94f90119f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.738193 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554a6f2-290b-4375-835b-a94f90119f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:43.739776 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554a6f2-290b-4375-835b-a94f90119f29 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:43.750334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1307/2622] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:12:43.754496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c14f1-a0d9-4187-bb03-118412f0632f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:43.764423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c14f1-a0d9-4187-bb03-118412f0632f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:43.769661 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd67345-a6c3-45be-8d65-b07f6ca776eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:43.770303 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd67345-a6c3-45be-8d65-b07f6ca776eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.770616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd67345-a6c3-45be-8d65-b07f6ca776eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.770893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd67345-a6c3-45be-8d65-b07f6ca776eb admin admin] PATH_INFO: `/v3/projects/83e8d1eb8a8d4ee4913b028f34cc6c41/users/66336287be114a8190fc3964f423bbb1/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.787832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd67345-a6c3-45be-8d65-b07f6ca776eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e8d1eb8a8d4ee4913b028f34cc6c41, user_id=66336287be114a8190fc3964f423bbb1, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:43.790484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd67345-a6c3-45be-8d65-b07f6ca776eb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:43.804054 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1316/2623] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:12:43 2022] PUT /identity/v3/projects/83e8d1eb8a8d4ee4913b028f34cc6c41/users/66336287be114a8190fc3964f423bbb1/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:12:43.809600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56cc01-872d-46e5-8b14-4fa74dad54b7 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.809890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56cc01-872d-46e5-8b14-4fa74dad54b7 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.810167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56cc01-872d-46e5-8b14-4fa74dad54b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.830063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0e56cc01-872d-46e5-8b14-4fa74dad54b7 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:12:43.831273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0e56cc01-872d-46e5-8b14-4fa74dad54b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:43.888857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1308/2624] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:12:43.898538 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd67345-a6c3-45be-8d65-b07f6ca776eb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:43.900354 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5fd67345-a6c3-45be-8d65-b07f6ca776eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:43.969064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd67345-a6c3-45be-8d65-b07f6ca776eb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:43.972639 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62822edf-a23b-4056-88ba-2c82a4cd028b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:43.973244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822edf-a23b-4056-88ba-2c82a4cd028b service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:43.973521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822edf-a23b-4056-88ba-2c82a4cd028b service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:43.973789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822edf-a23b-4056-88ba-2c82a4cd028b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:43.982611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62822edf-a23b-4056-88ba-2c82a4cd028b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:43.984569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62822edf-a23b-4056-88ba-2c82a4cd028b service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:43.994069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1317/2625] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:12:48.021631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928dc8b-5366-445f-9d9b-334973050545 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:48.022232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928dc8b-5366-445f-9d9b-334973050545 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:48.022232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928dc8b-5366-445f-9d9b-334973050545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:48.053653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9928dc8b-5366-445f-9d9b-334973050545 None None] MFA Rules not processed for user `66336287be114a8190fc3964f423bbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:12:48.054891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9928dc8b-5366-445f-9d9b-334973050545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:48.123049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1309/2626] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:12:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:12:48.138163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62822edf-a23b-4056-88ba-2c82a4cd028b service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:12:48.139638 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-62822edf-a23b-4056-88ba-2c82a4cd028b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:48.218335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62822edf-a23b-4056-88ba-2c82a4cd028b service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:12:48.223934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10594fe1-7ff4-48a6-9814-a327a45111e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:12:48.224587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10594fe1-7ff4-48a6-9814-a327a45111e7 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:48.224873 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10594fe1-7ff4-48a6-9814-a327a45111e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:48.225152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10594fe1-7ff4-48a6-9814-a327a45111e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:48.233178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10594fe1-7ff4-48a6-9814-a327a45111e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:12:48.234797 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10594fe1-7ff4-48a6-9814-a327a45111e7 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:12:48.239430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:48.244319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1318/2627] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:12:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:12:49.514647 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849b28-a9b5-4d0a-92a6-60172ee35472 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:12:49.515736 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849b28-a9b5-4d0a-92a6-60172ee35472 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:12:49.515836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849b28-a9b5-4d0a-92a6-60172ee35472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:12:49.535192 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-85849b28-a9b5-4d0a-92a6-60172ee35472 None None] MFA Rules not processed for user `66336287be114a8190fc3964f423bbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:12:49.536739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-85849b28-a9b5-4d0a-92a6-60172ee35472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:12:49.543650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1310/2628] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:12:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:12:59.530174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:40.906901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10594fe1-7ff4-48a6-9814-a327a45111e7 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:40.908307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-10594fe1-7ff4-48a6-9814-a327a45111e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:40.920033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10594fe1-7ff4-48a6-9814-a327a45111e7 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:40.923602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf4d7e-0bc0-4d0e-9c08-3e71b25ee38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:40.924191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf4d7e-0bc0-4d0e-9c08-3e71b25ee38e service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:40.924483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf4d7e-0bc0-4d0e-9c08-3e71b25ee38e service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:40.924767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf4d7e-0bc0-4d0e-9c08-3e71b25ee38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:40.926410 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5abf4d7e-0bc0-4d0e-9c08-3e71b25ee38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:40.937727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf4d7e-0bc0-4d0e-9c08-3e71b25ee38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:40.939130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf4d7e-0bc0-4d0e-9c08-3e71b25ee38e service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:40.948524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1319/2629] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:13:43.997353 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849b28-a9b5-4d0a-92a6-60172ee35472 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:43.998965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-85849b28-a9b5-4d0a-92a6-60172ee35472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:44.063509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf4d7e-0bc0-4d0e-9c08-3e71b25ee38e service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:44.065029 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5abf4d7e-0bc0-4d0e-9c08-3e71b25ee38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:44.074212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849b28-a9b5-4d0a-92a6-60172ee35472 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:44.082213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238e253-def4-4def-b7ba-6bb28f35cbe9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:44.082921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238e253-def4-4def-b7ba-6bb28f35cbe9 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.083318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238e253-def4-4def-b7ba-6bb28f35cbe9 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.083659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238e253-def4-4def-b7ba-6bb28f35cbe9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.085545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b238e253-def4-4def-b7ba-6bb28f35cbe9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:44.086115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf4d7e-0bc0-4d0e-9c08-3e71b25ee38e service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:44.090965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:44.091588 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.091901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.092225 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] PATH_INFO: `/v3/users/53327160ebb04585b414ad1571259834` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.093948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53327160ebb04585b414ad1571259834)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:44.095856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:44.099047 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238e253-def4-4def-b7ba-6bb28f35cbe9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:44.101300 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238e253-def4-4def-b7ba-6bb28f35cbe9 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:44.112889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1311/2630] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:13:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:13:44.148759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53327160ebb04585b414ad1571259834'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:44.149413 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53327160ebb04585b414ad1571259834'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:44.161352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53327160ebb04585b414ad1571259834'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:44.168093 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53327160ebb04585b414ad1571259834'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:44.168757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-48cf97d3-c1c7-4eb9-bc79-686418c6ceb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53327160ebb04585b414ad1571259834'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:44.181600 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1320/2631] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:13:44 2022] DELETE /identity/v3/users/53327160ebb04585b414ad1571259834 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:44.353313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238e253-def4-4def-b7ba-6bb28f35cbe9 service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:44.365651 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238e253-def4-4def-b7ba-6bb28f35cbe9 service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:44.421509 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:44.422143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.422438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.422699 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] PATH_INFO: `/v3/projects/147476b7d79a4f55ac9096f2cfa5c78c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.423794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=147476b7d79a4f55ac9096f2cfa5c78c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:44.425703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:44.470078 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147476b7d79a4f55ac9096f2cfa5c78c', 'request_id': 'req-50c922ab-3bdf-4cee-97d0-b0d54a48b764'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:44.475883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147476b7d79a4f55ac9096f2cfa5c78c', 'request_id': 'req-50c922ab-3bdf-4cee-97d0-b0d54a48b764'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:44.482470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147476b7d79a4f55ac9096f2cfa5c78c', 'request_id': 'req-50c922ab-3bdf-4cee-97d0-b0d54a48b764'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:44.492759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] The token cache is being invalidate because project 147476b7d79a4f55ac9096f2cfa5c78c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:13:44.493046 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:44.493660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-50c922ab-3bdf-4cee-97d0-b0d54a48b764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:44.495134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1312/2632] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:13:44 2022] DELETE /identity/v3/projects/147476b7d79a4f55ac9096f2cfa5c78c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:44.500575 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585372b-2b11-4d9e-81e2-b09c0bc36b50 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.500859 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585372b-2b11-4d9e-81e2-b09c0bc36b50 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.501131 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585372b-2b11-4d9e-81e2-b09c0bc36b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.520405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4585372b-2b11-4d9e-81e2-b09c0bc36b50 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:44.521612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4585372b-2b11-4d9e-81e2-b09c0bc36b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:44.577755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1321/2633] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:13:44.586580 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76317efc-248a-4264-9f5e-db9dc62ff0db None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.586870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76317efc-248a-4264-9f5e-db9dc62ff0db None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.587145 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76317efc-248a-4264-9f5e-db9dc62ff0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.606952 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-76317efc-248a-4264-9f5e-db9dc62ff0db None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:44.608687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-76317efc-248a-4264-9f5e-db9dc62ff0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:44.616439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1313/2634] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:44.620449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585372b-2b11-4d9e-81e2-b09c0bc36b50 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:44.630525 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585372b-2b11-4d9e-81e2-b09c0bc36b50 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:44.634971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8e78b-034d-42ac-af95-7007e4acf34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:44.635559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8e78b-034d-42ac-af95-7007e4acf34d admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.635838 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8e78b-034d-42ac-af95-7007e4acf34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.636110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8e78b-034d-42ac-af95-7007e4acf34d admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.636773 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8e78b-034d-42ac-af95-7007e4acf34d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:13:44.637102 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8e78b-034d-42ac-af95-7007e4acf34d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:44.638677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8e78b-034d-42ac-af95-7007e4acf34d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:44.649806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1322/2635] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:13:44.654147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76317efc-248a-4264-9f5e-db9dc62ff0db None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:44.663269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76317efc-248a-4264-9f5e-db9dc62ff0db None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:44.668131 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316500c-e63f-443b-b0d7-88bbbde83bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:44.668788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316500c-e63f-443b-b0d7-88bbbde83bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.669074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316500c-e63f-443b-b0d7-88bbbde83bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.669351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316500c-e63f-443b-b0d7-88bbbde83bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.669978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316500c-e63f-443b-b0d7-88bbbde83bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:44.672448 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316500c-e63f-443b-b0d7-88bbbde83bc3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:44.683694 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:44.700402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1314/2636] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:13:44 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:13:44.704390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8e78b-034d-42ac-af95-7007e4acf34d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:44.714076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8e78b-034d-42ac-af95-7007e4acf34d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:44.759386 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:44.772745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1de2e0-5adc-43e2-bb89-e9006e9db27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:44.773357 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1de2e0-5adc-43e2-bb89-e9006e9db27f admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.773635 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1de2e0-5adc-43e2-bb89-e9006e9db27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.773909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1de2e0-5adc-43e2-bb89-e9006e9db27f admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.774531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1de2e0-5adc-43e2-bb89-e9006e9db27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:44.776431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1de2e0-5adc-43e2-bb89-e9006e9db27f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:44.796364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1323/2637] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:13:44 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:13:44.800417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316500c-e63f-443b-b0d7-88bbbde83bc3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:44.810542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316500c-e63f-443b-b0d7-88bbbde83bc3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:44.815741 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd76de-3be1-4b93-af34-801554c79a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:44.816335 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd76de-3be1-4b93-af34-801554c79a6e admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.816646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd76de-3be1-4b93-af34-801554c79a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.816920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd76de-3be1-4b93-af34-801554c79a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.817554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd76de-3be1-4b93-af34-801554c79a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:44.819127 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd76de-3be1-4b93-af34-801554c79a6e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:44.828845 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1315/2638] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:13:44.832493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1de2e0-5adc-43e2-bb89-e9006e9db27f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:44.842540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1de2e0-5adc-43e2-bb89-e9006e9db27f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:44.847120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9603a-cd34-4678-887e-65bcc39a2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:44.847712 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9603a-cd34-4678-887e-65bcc39a2cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.847990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9603a-cd34-4678-887e-65bcc39a2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.848268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9603a-cd34-4678-887e-65bcc39a2cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.848940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9603a-cd34-4678-887e-65bcc39a2cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:44.850509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9603a-cd34-4678-887e-65bcc39a2cd0 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:44.861262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1324/2639] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:13:44.865109 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd76de-3be1-4b93-af34-801554c79a6e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:44.875355 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd76de-3be1-4b93-af34-801554c79a6e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:44.879918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09370e-4e86-422b-a5ac-bd82e4585769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:44.880599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09370e-4e86-422b-a5ac-bd82e4585769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.880877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09370e-4e86-422b-a5ac-bd82e4585769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.881148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09370e-4e86-422b-a5ac-bd82e4585769 admin admin] PATH_INFO: `/v3/projects/67b02d041a2c48b8b82bc6097ac2c467/users/eaf51b6a7e2040e8908dcfa581a05c65/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.895232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09370e-4e86-422b-a5ac-bd82e4585769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b02d041a2c48b8b82bc6097ac2c467, user_id=eaf51b6a7e2040e8908dcfa581a05c65, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:44.897873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09370e-4e86-422b-a5ac-bd82e4585769 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:44.910201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1316/2640] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:13:44 2022] PUT /identity/v3/projects/67b02d041a2c48b8b82bc6097ac2c467/users/eaf51b6a7e2040e8908dcfa581a05c65/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:44.921140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae936-28f1-464e-a5b1-508a89cf98e1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:44.921451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae936-28f1-464e-a5b1-508a89cf98e1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:44.921730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae936-28f1-464e-a5b1-508a89cf98e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:44.949018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-939ae936-28f1-464e-a5b1-508a89cf98e1 None None] MFA Rules not processed for user `eaf51b6a7e2040e8908dcfa581a05c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:44.950264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-939ae936-28f1-464e-a5b1-508a89cf98e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:45.013334 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1325/2641] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:45.024415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09370e-4e86-422b-a5ac-bd82e4585769 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:45.026270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6f09370e-4e86-422b-a5ac-bd82e4585769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:45.102932 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09370e-4e86-422b-a5ac-bd82e4585769 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:45.106771 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a7afd-1dc2-48d5-8c46-09f8130b2278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:45.107375 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7afd-1dc2-48d5-8c46-09f8130b2278 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:45.107657 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7afd-1dc2-48d5-8c46-09f8130b2278 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:45.107954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7afd-1dc2-48d5-8c46-09f8130b2278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:45.116143 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a7afd-1dc2-48d5-8c46-09f8130b2278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:45.117591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a7afd-1dc2-48d5-8c46-09f8130b2278 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:45.126674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1317/2642] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:13:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:13:53.400093 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ae936-28f1-464e-a5b1-508a89cf98e1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:53.460124 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ae936-28f1-464e-a5b1-508a89cf98e1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:53.464887 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:53.465508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:53.465789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:53.466063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] PATH_INFO: `/v3/users/eaf51b6a7e2040e8908dcfa581a05c65` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:53.467167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf51b6a7e2040e8908dcfa581a05c65)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:53.469645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:53.514677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf51b6a7e2040e8908dcfa581a05c65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:53.515325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf51b6a7e2040e8908dcfa581a05c65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:53.522767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:53.528834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf51b6a7e2040e8908dcfa581a05c65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:53.537554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf51b6a7e2040e8908dcfa581a05c65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:53.538214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf51b6a7e2040e8908dcfa581a05c65'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:53.552228 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1326/2643] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:13:53 2022] DELETE /identity/v3/users/eaf51b6a7e2040e8908dcfa581a05c65 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:53.556715 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab6990-b5db-45b0-85ee-d5f73ca799b9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:53.557223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab6990-b5db-45b0-85ee-d5f73ca799b9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:53.557326 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab6990-b5db-45b0-85ee-d5f73ca799b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:53.575915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4dab6990-b5db-45b0-85ee-d5f73ca799b9 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:53.577152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4dab6990-b5db-45b0-85ee-d5f73ca799b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:53.636291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1318/2644] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:53.646398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:53.647780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:53.702733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a08fc6-f17b-4f85-8a9f-0971b2556568 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:53.706927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ac8ad-c512-4b8c-8023-a3c7627de6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:53.707523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac8ad-c512-4b8c-8023-a3c7627de6cf service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:53.707799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac8ad-c512-4b8c-8023-a3c7627de6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:53.708070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ac8ad-c512-4b8c-8023-a3c7627de6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:53.717076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ac8ad-c512-4b8c-8023-a3c7627de6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:53.718484 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ac8ad-c512-4b8c-8023-a3c7627de6cf service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:53.728632 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1327/2645] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:13:53.993894 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab6990-b5db-45b0-85ee-d5f73ca799b9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:53.995326 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4dab6990-b5db-45b0-85ee-d5f73ca799b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:54.007327 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab6990-b5db-45b0-85ee-d5f73ca799b9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.013019 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.013659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.013936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.014208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] PATH_INFO: `/v3/projects/67b02d041a2c48b8b82bc6097ac2c467` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.015333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b02d041a2c48b8b82bc6097ac2c467)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.017263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.055871 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:54.066299 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b02d041a2c48b8b82bc6097ac2c467', 'request_id': 'req-f777266f-6ef5-4123-99f1-fbfddae7e3a5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:54.072413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b02d041a2c48b8b82bc6097ac2c467', 'request_id': 'req-f777266f-6ef5-4123-99f1-fbfddae7e3a5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:54.079477 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b02d041a2c48b8b82bc6097ac2c467', 'request_id': 'req-f777266f-6ef5-4123-99f1-fbfddae7e3a5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:54.089791 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] The token cache is being invalidate because project 67b02d041a2c48b8b82bc6097ac2c467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:13:54.090093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:54.090698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-f777266f-6ef5-4123-99f1-fbfddae7e3a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:54.092156 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1319/2646] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:13:53 2022] DELETE /identity/v3/projects/67b02d041a2c48b8b82bc6097ac2c467 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:54.097407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d4deb-18dc-4066-b283-8212d527456d None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.097763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d4deb-18dc-4066-b283-8212d527456d None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.098107 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d4deb-18dc-4066-b283-8212d527456d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.118166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-385d4deb-18dc-4066-b283-8212d527456d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:54.119523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-385d4deb-18dc-4066-b283-8212d527456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:54.177531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1328/2647] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:13:54.185405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea41cd-984d-4c5e-acb3-d44ed794b295 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.185690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea41cd-984d-4c5e-acb3-d44ed794b295 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.185961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea41cd-984d-4c5e-acb3-d44ed794b295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.204704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-03ea41cd-984d-4c5e-acb3-d44ed794b295 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:54.205889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-03ea41cd-984d-4c5e-acb3-d44ed794b295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:54.213600 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1320/2648] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:54.217938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d4deb-18dc-4066-b283-8212d527456d None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.227888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d4deb-18dc-4066-b283-8212d527456d None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.232308 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292a7c1-fef7-4d55-9491-d210eb2a661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.232929 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a7c1-fef7-4d55-9491-d210eb2a661f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.233208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a7c1-fef7-4d55-9491-d210eb2a661f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.233479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a7c1-fef7-4d55-9491-d210eb2a661f admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.234115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292a7c1-fef7-4d55-9491-d210eb2a661f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:13:54.236651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292a7c1-fef7-4d55-9491-d210eb2a661f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.238257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292a7c1-fef7-4d55-9491-d210eb2a661f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.250024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1329/2649] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:13:54.254231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea41cd-984d-4c5e-acb3-d44ed794b295 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.263280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea41cd-984d-4c5e-acb3-d44ed794b295 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.268440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7149ba-c121-43a4-ab8e-9a8dc2406196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.269059 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7149ba-c121-43a4-ab8e-9a8dc2406196 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.269346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7149ba-c121-43a4-ab8e-9a8dc2406196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.269621 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7149ba-c121-43a4-ab8e-9a8dc2406196 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.270247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7149ba-c121-43a4-ab8e-9a8dc2406196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.272117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7149ba-c121-43a4-ab8e-9a8dc2406196 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.298828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1321/2650] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:13:54 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:13:54.302939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292a7c1-fef7-4d55-9491-d210eb2a661f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.312811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292a7c1-fef7-4d55-9491-d210eb2a661f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.370832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d46f3-a1b5-4fc7-8442-ea133bf15603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.371429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d46f3-a1b5-4fc7-8442-ea133bf15603 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.371710 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d46f3-a1b5-4fc7-8442-ea133bf15603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.371984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d46f3-a1b5-4fc7-8442-ea133bf15603 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.372631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d46f3-a1b5-4fc7-8442-ea133bf15603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.374529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d46f3-a1b5-4fc7-8442-ea133bf15603 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.384324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:54.397319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1330/2651] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:13:54 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:13:54.401287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7149ba-c121-43a4-ab8e-9a8dc2406196 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.412167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7149ba-c121-43a4-ab8e-9a8dc2406196 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.416735 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac08be4-5a0d-436e-ae22-071a5a5b9dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.417333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac08be4-5a0d-436e-ae22-071a5a5b9dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.417609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac08be4-5a0d-436e-ae22-071a5a5b9dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.417882 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac08be4-5a0d-436e-ae22-071a5a5b9dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.418518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac08be4-5a0d-436e-ae22-071a5a5b9dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.420124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac08be4-5a0d-436e-ae22-071a5a5b9dd6 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.429856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1322/2652] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:13:54.435191 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d46f3-a1b5-4fc7-8442-ea133bf15603 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.445103 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d46f3-a1b5-4fc7-8442-ea133bf15603 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.449731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bf18f-8a66-4fcd-af4c-6a102c538191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.450326 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bf18f-8a66-4fcd-af4c-6a102c538191 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.450612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bf18f-8a66-4fcd-af4c-6a102c538191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.450888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bf18f-8a66-4fcd-af4c-6a102c538191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.451531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bf18f-8a66-4fcd-af4c-6a102c538191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.453656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bf18f-8a66-4fcd-af4c-6a102c538191 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.463980 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1331/2653] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:13:54.468067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac08be4-5a0d-436e-ae22-071a5a5b9dd6 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.478369 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac08be4-5a0d-436e-ae22-071a5a5b9dd6 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.482868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12070c9-c2b6-427b-ba90-ce92db10a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.483512 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12070c9-c2b6-427b-ba90-ce92db10a08a admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.483788 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12070c9-c2b6-427b-ba90-ce92db10a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.484063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12070c9-c2b6-427b-ba90-ce92db10a08a admin admin] PATH_INFO: `/v3/projects/b04dab760ea04cc0a00ced3367ab7068/users/616a7116d6af43f790b79213847caa54/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.498090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12070c9-c2b6-427b-ba90-ce92db10a08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04dab760ea04cc0a00ced3367ab7068, user_id=616a7116d6af43f790b79213847caa54, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.500725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12070c9-c2b6-427b-ba90-ce92db10a08a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.512591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1323/2654] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:13:54 2022] PUT /identity/v3/projects/b04dab760ea04cc0a00ced3367ab7068/users/616a7116d6af43f790b79213847caa54/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:54.522984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fd0ef-6d2a-4dbc-a52a-5f7dbc473d43 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.523276 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fd0ef-6d2a-4dbc-a52a-5f7dbc473d43 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.523943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fd0ef-6d2a-4dbc-a52a-5f7dbc473d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.551324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-740fd0ef-6d2a-4dbc-a52a-5f7dbc473d43 None None] MFA Rules not processed for user `616a7116d6af43f790b79213847caa54`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:54.552572 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-740fd0ef-6d2a-4dbc-a52a-5f7dbc473d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:54.614711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1332/2655] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:54.619126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12070c9-c2b6-427b-ba90-ce92db10a08a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.679789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12070c9-c2b6-427b-ba90-ce92db10a08a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.684422 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c8290-f037-49a7-b8ed-ef441a6228a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.685052 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c8290-f037-49a7-b8ed-ef441a6228a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.685336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c8290-f037-49a7-b8ed-ef441a6228a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.685617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c8290-f037-49a7-b8ed-ef441a6228a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.686232 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c8290-f037-49a7-b8ed-ef441a6228a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.688689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c8290-f037-49a7-b8ed-ef441a6228a4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.715104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1324/2656] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:13:54 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:13:54.719229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fd0ef-6d2a-4dbc-a52a-5f7dbc473d43 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.729886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fd0ef-6d2a-4dbc-a52a-5f7dbc473d43 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.785629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19b26b-ccb6-408b-8e14-413d8aad981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.786244 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19b26b-ccb6-408b-8e14-413d8aad981c admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.786527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19b26b-ccb6-408b-8e14-413d8aad981c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.786810 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19b26b-ccb6-408b-8e14-413d8aad981c admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.787430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19b26b-ccb6-408b-8e14-413d8aad981c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.789362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19b26b-ccb6-408b-8e14-413d8aad981c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.809756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1333/2657] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:13:54 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:13:54.814417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c8290-f037-49a7-b8ed-ef441a6228a4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.824610 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c8290-f037-49a7-b8ed-ef441a6228a4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.829748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6e278-ae4e-4fa7-957e-b69313b78654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.830347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6e278-ae4e-4fa7-957e-b69313b78654 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.830624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6e278-ae4e-4fa7-957e-b69313b78654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.830892 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6e278-ae4e-4fa7-957e-b69313b78654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.831525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6e278-ae4e-4fa7-957e-b69313b78654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.833140 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6e278-ae4e-4fa7-957e-b69313b78654 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.843616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1325/2658] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:13:54.847467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19b26b-ccb6-408b-8e14-413d8aad981c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.857324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19b26b-ccb6-408b-8e14-413d8aad981c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.861948 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61cbb8-3c05-44eb-85bc-24e94b17619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.862591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61cbb8-3c05-44eb-85bc-24e94b17619b admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.862877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61cbb8-3c05-44eb-85bc-24e94b17619b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.863155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61cbb8-3c05-44eb-85bc-24e94b17619b admin admin] PATH_INFO: `/v3/projects/2924b4d7d4b1452295c926917dfb6e84/users/498bb9a5761846cf844218699ca81edb/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.878033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61cbb8-3c05-44eb-85bc-24e94b17619b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2924b4d7d4b1452295c926917dfb6e84, user_id=498bb9a5761846cf844218699ca81edb, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.880691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61cbb8-3c05-44eb-85bc-24e94b17619b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.894457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1334/2659] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:13:54 2022] PUT /identity/v3/projects/2924b4d7d4b1452295c926917dfb6e84/users/498bb9a5761846cf844218699ca81edb/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:54.898371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6e278-ae4e-4fa7-957e-b69313b78654 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.908212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6e278-ae4e-4fa7-957e-b69313b78654 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.938115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:54.965421 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3416df-90bc-4d54-ab1d-b06b5868b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.966023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3416df-90bc-4d54-ab1d-b06b5868b698 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.966301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3416df-90bc-4d54-ab1d-b06b5868b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.966570 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3416df-90bc-4d54-ab1d-b06b5868b698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:54.967197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3416df-90bc-4d54-ab1d-b06b5868b698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:54.968800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3416df-90bc-4d54-ab1d-b06b5868b698 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:54.978162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1326/2660] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:13:54.982285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61cbb8-3c05-44eb-85bc-24e94b17619b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:54.993013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61cbb8-3c05-44eb-85bc-24e94b17619b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:54.997631 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd117455-2115-41d2-a49f-2782e3ee5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:54.998278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd117455-2115-41d2-a49f-2782e3ee5155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:54.998560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd117455-2115-41d2-a49f-2782e3ee5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:54.998835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd117455-2115-41d2-a49f-2782e3ee5155 admin admin] PATH_INFO: `/v3/projects/2924b4d7d4b1452295c926917dfb6e84/users/498bb9a5761846cf844218699ca81edb/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:55.001292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd117455-2115-41d2-a49f-2782e3ee5155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2924b4d7d4b1452295c926917dfb6e84, user_id=498bb9a5761846cf844218699ca81edb, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:55.003896 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd117455-2115-41d2-a49f-2782e3ee5155 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:55.014058 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1335/2661] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:13:54 2022] PUT /identity/v3/projects/2924b4d7d4b1452295c926917dfb6e84/users/498bb9a5761846cf844218699ca81edb/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:55.023995 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79bfd-6086-4584-a721-d2a465e30286 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:55.024282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79bfd-6086-4584-a721-d2a465e30286 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:55.024588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79bfd-6086-4584-a721-d2a465e30286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:55.052013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b1f79bfd-6086-4584-a721-d2a465e30286 None None] MFA Rules not processed for user `498bb9a5761846cf844218699ca81edb`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:55.053256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b1f79bfd-6086-4584-a721-d2a465e30286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:55.121711 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1327/2662] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:55.134477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd117455-2115-41d2-a49f-2782e3ee5155 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:55.136146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cd117455-2115-41d2-a49f-2782e3ee5155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:55.162926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:55.194247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd117455-2115-41d2-a49f-2782e3ee5155 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:55.197776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec33e1c-07f9-45b2-a9a2-7ce66c2da588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:55.198379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec33e1c-07f9-45b2-a9a2-7ce66c2da588 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:55.198660 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec33e1c-07f9-45b2-a9a2-7ce66c2da588 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:55.198936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec33e1c-07f9-45b2-a9a2-7ce66c2da588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:55.207645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec33e1c-07f9-45b2-a9a2-7ce66c2da588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:55.209110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec33e1c-07f9-45b2-a9a2-7ce66c2da588 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:55.218700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1336/2663] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:13:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:13:55.516029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f79bfd-6086-4584-a721-d2a465e30286 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:55.524938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f79bfd-6086-4584-a721-d2a465e30286 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:55.529432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1499632-52ef-4d11-b422-76bae9879828 tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '498bb9a5761846cf844218699ca81edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2924b4d7d4b1452295c926917dfb6e84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:55.530029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1499632-52ef-4d11-b422-76bae9879828 tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:55.530310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1499632-52ef-4d11-b422-76bae9879828 tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:55.530585 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1499632-52ef-4d11-b422-76bae9879828 tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:55.531225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1499632-52ef-4d11-b422-76bae9879828 tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:13:55.532042 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1499632-52ef-4d11-b422-76bae9879828 tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:55.533654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1499632-52ef-4d11-b422-76bae9879828 tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:55.545113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1328/2664] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:13:55.549573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec33e1c-07f9-45b2-a9a2-7ce66c2da588 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:55.558597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec33e1c-07f9-45b2-a9a2-7ce66c2da588 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:55.563149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461e810-4ac5-48c1-9a9c-e23e4ef92b3f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '498bb9a5761846cf844218699ca81edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2924b4d7d4b1452295c926917dfb6e84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:55.563746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e810-4ac5-48c1-9a9c-e23e4ef92b3f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:55.564028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e810-4ac5-48c1-9a9c-e23e4ef92b3f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:55.564306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e810-4ac5-48c1-9a9c-e23e4ef92b3f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:55.564971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461e810-4ac5-48c1-9a9c-e23e4ef92b3f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:55.566852 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461e810-4ac5-48c1-9a9c-e23e4ef92b3f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:55.592168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1337/2665] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:13:55 2022] POST /identity/v3/projects => generated 353 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:13:55.596615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1499632-52ef-4d11-b422-76bae9879828 tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:55.606457 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1499632-52ef-4d11-b422-76bae9879828 tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:55.660836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7174e8-82de-41cd-9267-a21faca4a89f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '498bb9a5761846cf844218699ca81edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2924b4d7d4b1452295c926917dfb6e84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:55.661466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7174e8-82de-41cd-9267-a21faca4a89f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:55.661713 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7174e8-82de-41cd-9267-a21faca4a89f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:55.661997 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7174e8-82de-41cd-9267-a21faca4a89f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:55.662642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7174e8-82de-41cd-9267-a21faca4a89f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:13:55.662956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7174e8-82de-41cd-9267-a21faca4a89f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:55.664576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7174e8-82de-41cd-9267-a21faca4a89f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:55.677560 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1329/2666] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:13:55.712695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461e810-4ac5-48c1-9a9c-e23e4ef92b3f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:55.723642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461e810-4ac5-48c1-9a9c-e23e4ef92b3f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:55.728238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '498bb9a5761846cf844218699ca81edb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2924b4d7d4b1452295c926917dfb6e84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:55.728849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:55.729134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:55.729412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] PATH_INFO: `/v3/projects/1b13f9fbb706484f8b888bacca8ea888` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:55.730551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b13f9fbb706484f8b888bacca8ea888)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:55.732443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:55.778547 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b13f9fbb706484f8b888bacca8ea888', 'request_id': 'req-f203b7ba-0740-4b9f-8449-58ffc1fd451a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:55.786520 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b13f9fbb706484f8b888bacca8ea888', 'request_id': 'req-f203b7ba-0740-4b9f-8449-58ffc1fd451a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:55.793585 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b13f9fbb706484f8b888bacca8ea888', 'request_id': 'req-f203b7ba-0740-4b9f-8449-58ffc1fd451a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:55.803720 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] The token cache is being invalidate because project 1b13f9fbb706484f8b888bacca8ea888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:13:55.804010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:55.804737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-f203b7ba-0740-4b9f-8449-58ffc1fd451a tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:55.806325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1338/2667] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:13:55 2022] DELETE /identity/v3/projects/1b13f9fbb706484f8b888bacca8ea888 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:55.990655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7174e8-82de-41cd-9267-a21faca4a89f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:55.992672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5a7174e8-82de-41cd-9267-a21faca4a89f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:56.033626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:56.058135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7174e8-82de-41cd-9267-a21faca4a89f tempest-VolumeQuotaClassesTest-829342626 tempest-VolumeQuotaClassesTest-829342626-project-admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:56.114079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:56.114744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:56.115026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:56.115308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] PATH_INFO: `/v3/users/616a7116d6af43f790b79213847caa54` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:56.116443 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] RBAC: Authorizing `identity:delete_user(user_id=616a7116d6af43f790b79213847caa54)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:56.118390 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:56.163476 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616a7116d6af43f790b79213847caa54'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.170264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616a7116d6af43f790b79213847caa54'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.170891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616a7116d6af43f790b79213847caa54'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.171487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616a7116d6af43f790b79213847caa54'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.178169 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616a7116d6af43f790b79213847caa54'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.195908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1330/2668] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:13:55 2022] DELETE /identity/v3/users/616a7116d6af43f790b79213847caa54 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:56.201193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8006d8-ba72-475a-9fb4-979f27252da3 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:56.201479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8006d8-ba72-475a-9fb4-979f27252da3 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:56.201756 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8006d8-ba72-475a-9fb4-979f27252da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:56.221219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-cf8006d8-ba72-475a-9fb4-979f27252da3 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:56.222421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cf8006d8-ba72-475a-9fb4-979f27252da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:56.283081 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1339/2669] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:56.292758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:56.294164 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:56.350777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eecd1-f130-4d86-add3-d8b5e46853da admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:56.354347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e02245-d338-4f9d-a459-8303d3a7bd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:56.354950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e02245-d338-4f9d-a459-8303d3a7bd0e service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:56.355228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e02245-d338-4f9d-a459-8303d3a7bd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:56.355498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e02245-d338-4f9d-a459-8303d3a7bd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:56.365685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e02245-d338-4f9d-a459-8303d3a7bd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:56.367094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e02245-d338-4f9d-a459-8303d3a7bd0e service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:56.376346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1331/2670] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:13:56.641726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8006d8-ba72-475a-9fb4-979f27252da3 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:56.643199 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-cf8006d8-ba72-475a-9fb4-979f27252da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:56.655649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8006d8-ba72-475a-9fb4-979f27252da3 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:56.660988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:56.661633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:56.661915 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:56.662667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] PATH_INFO: `/v3/projects/b04dab760ea04cc0a00ced3367ab7068` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:56.663350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b04dab760ea04cc0a00ced3367ab7068)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:56.665375 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:56.690479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:56.714453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04dab760ea04cc0a00ced3367ab7068', 'request_id': 'req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.722233 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04dab760ea04cc0a00ced3367ab7068', 'request_id': 'req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.729061 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04dab760ea04cc0a00ced3367ab7068', 'request_id': 'req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.740271 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] The token cache is being invalidate because project b04dab760ea04cc0a00ced3367ab7068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:13:56.740595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.741417 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.742685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1340/2671] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:13:56 2022] DELETE /identity/v3/projects/b04dab760ea04cc0a00ced3367ab7068 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:56.746688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e02245-d338-4f9d-a459-8303d3a7bd0e service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:56.753239 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:56.757367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e02245-d338-4f9d-a459-8303d3a7bd0e service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:56.815038 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:56.815666 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:56.815947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:56.816223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] PATH_INFO: `/v3/users/498bb9a5761846cf844218699ca81edb` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:56.817416 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=498bb9a5761846cf844218699ca81edb)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:56.819256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:56.863719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498bb9a5761846cf844218699ca81edb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.871697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498bb9a5761846cf844218699ca81edb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.872348 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498bb9a5761846cf844218699ca81edb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.872980 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498bb9a5761846cf844218699ca81edb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.879860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-ca5c4b5d-8204-4dda-a888-824205c94fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498bb9a5761846cf844218699ca81edb'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:56.897020 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1332/2672] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:13:56 2022] DELETE /identity/v3/users/498bb9a5761846cf844218699ca81edb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:57.160489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:57.161926 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:57.176899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a097-14d4-47d5-bbd9-957ffa99e2e4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:57.235409 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:57.236045 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.236324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.236627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] PATH_INFO: `/v3/projects/2924b4d7d4b1452295c926917dfb6e84` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.237733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2924b4d7d4b1452295c926917dfb6e84)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:57.239627 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:57.284085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2924b4d7d4b1452295c926917dfb6e84', 'request_id': 'req-51f33866-6b35-45d0-9a27-dfcc170a5a32'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:57.291470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2924b4d7d4b1452295c926917dfb6e84', 'request_id': 'req-51f33866-6b35-45d0-9a27-dfcc170a5a32'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:57.298231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2924b4d7d4b1452295c926917dfb6e84', 'request_id': 'req-51f33866-6b35-45d0-9a27-dfcc170a5a32'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:57.308198 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] The token cache is being invalidate because project 2924b4d7d4b1452295c926917dfb6e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:13:57.308509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:57.309129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-51f33866-6b35-45d0-9a27-dfcc170a5a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:57.310590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1341/2673] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:13:57 2022] DELETE /identity/v3/projects/2924b4d7d4b1452295c926917dfb6e84 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:57.315941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e3a0-23b3-434a-83c6-85e6548a2154 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.316230 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e3a0-23b3-434a-83c6-85e6548a2154 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.316537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e3a0-23b3-434a-83c6-85e6548a2154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.335779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-dfe0e3a0-23b3-434a-83c6-85e6548a2154 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:57.336949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dfe0e3a0-23b3-434a-83c6-85e6548a2154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:57.394198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1333/2674] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:57.403076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73dc05-6b9d-43ac-b803-2a3a51ac239a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.403367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73dc05-6b9d-43ac-b803-2a3a51ac239a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.403648 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73dc05-6b9d-43ac-b803-2a3a51ac239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.423106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7d73dc05-6b9d-43ac-b803-2a3a51ac239a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:57.424296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7d73dc05-6b9d-43ac-b803-2a3a51ac239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:57.432727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1342/2675] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:57.436770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0e3a0-23b3-434a-83c6-85e6548a2154 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:57.447111 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0e3a0-23b3-434a-83c6-85e6548a2154 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:57.452495 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a9857-64e3-4ba2-b64a-b9098473e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:57.453245 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a9857-64e3-4ba2-b64a-b9098473e899 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.453535 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a9857-64e3-4ba2-b64a-b9098473e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.453792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a9857-64e3-4ba2-b64a-b9098473e899 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.454442 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a9857-64e3-4ba2-b64a-b9098473e899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:13:57.454749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a9857-64e3-4ba2-b64a-b9098473e899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:57.456339 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a9857-64e3-4ba2-b64a-b9098473e899 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:57.468378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1334/2676] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:13:57.472794 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73dc05-6b9d-43ac-b803-2a3a51ac239a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:57.482201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73dc05-6b9d-43ac-b803-2a3a51ac239a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:57.487352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f442a-41bc-41bc-b6e7-bd6e8a5085f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:57.487940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f442a-41bc-41bc-b6e7-bd6e8a5085f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.488218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f442a-41bc-41bc-b6e7-bd6e8a5085f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.488530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f442a-41bc-41bc-b6e7-bd6e8a5085f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.489159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f442a-41bc-41bc-b6e7-bd6e8a5085f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:57.491027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f442a-41bc-41bc-b6e7-bd6e8a5085f9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:57.517737 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1343/2677] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:13:57 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:13:57.521858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a9857-64e3-4ba2-b64a-b9098473e899 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:57.531968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a9857-64e3-4ba2-b64a-b9098473e899 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:57.539438 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:57.589155 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a554d96-b6e1-4787-8f81-b8c6c8dfd86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:57.589955 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a554d96-b6e1-4787-8f81-b8c6c8dfd86f admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.590240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a554d96-b6e1-4787-8f81-b8c6c8dfd86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.590521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a554d96-b6e1-4787-8f81-b8c6c8dfd86f admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.591157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a554d96-b6e1-4787-8f81-b8c6c8dfd86f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:57.593113 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a554d96-b6e1-4787-8f81-b8c6c8dfd86f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:57.614460 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1335/2678] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:13:57 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:13:57.618549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f442a-41bc-41bc-b6e7-bd6e8a5085f9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:57.628749 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f442a-41bc-41bc-b6e7-bd6e8a5085f9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:57.633349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf76d8-babd-45cd-9e33-fef45b6ca9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:57.633947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf76d8-babd-45cd-9e33-fef45b6ca9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.634227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf76d8-babd-45cd-9e33-fef45b6ca9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.634500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf76d8-babd-45cd-9e33-fef45b6ca9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.635140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf76d8-babd-45cd-9e33-fef45b6ca9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:57.636831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf76d8-babd-45cd-9e33-fef45b6ca9f8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:57.646691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1344/2679] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:13:57.650208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a554d96-b6e1-4787-8f81-b8c6c8dfd86f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:57.660883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a554d96-b6e1-4787-8f81-b8c6c8dfd86f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:57.666529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914b0f8-c92f-4189-a29c-6c83a87d7e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:57.667208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b0f8-c92f-4189-a29c-6c83a87d7e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.667525 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b0f8-c92f-4189-a29c-6c83a87d7e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.667842 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b0f8-c92f-4189-a29c-6c83a87d7e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.668505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914b0f8-c92f-4189-a29c-6c83a87d7e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:57.670092 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914b0f8-c92f-4189-a29c-6c83a87d7e16 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:57.681780 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1336/2680] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:13:57.685936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf76d8-babd-45cd-9e33-fef45b6ca9f8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:57.691810 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:57.697514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf76d8-babd-45cd-9e33-fef45b6ca9f8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:57.703981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebdffe-2e2c-42e1-9b3a-f40d9f832c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:57.704718 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebdffe-2e2c-42e1-9b3a-f40d9f832c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.705170 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebdffe-2e2c-42e1-9b3a-f40d9f832c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.705446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebdffe-2e2c-42e1-9b3a-f40d9f832c9e admin admin] PATH_INFO: `/v3/projects/2c7a64a0bede48379031af2ca1b53da2/users/bd5e19a770b741ecb0034b3274aa67b7/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.720700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebdffe-2e2c-42e1-9b3a-f40d9f832c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7a64a0bede48379031af2ca1b53da2, user_id=bd5e19a770b741ecb0034b3274aa67b7, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:57.723407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebdffe-2e2c-42e1-9b3a-f40d9f832c9e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:57.736173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1345/2681] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:13:57 2022] PUT /identity/v3/projects/2c7a64a0bede48379031af2ca1b53da2/users/bd5e19a770b741ecb0034b3274aa67b7/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:57.746482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f53e7-a857-426e-a30b-f76db12c884c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.746767 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f53e7-a857-426e-a30b-f76db12c884c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.747310 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f53e7-a857-426e-a30b-f76db12c884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.774813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5d0f53e7-a857-426e-a30b-f76db12c884c None None] MFA Rules not processed for user `bd5e19a770b741ecb0034b3274aa67b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:57.776014 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5d0f53e7-a857-426e-a30b-f76db12c884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:57.838228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1337/2682] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:57.842956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebdffe-2e2c-42e1-9b3a-f40d9f832c9e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:57.903376 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebdffe-2e2c-42e1-9b3a-f40d9f832c9e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:57.908554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0d4e-5653-4ef3-8d8a-3ac75ef2b02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:57.909152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0d4e-5653-4ef3-8d8a-3ac75ef2b02a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:57.909434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0d4e-5653-4ef3-8d8a-3ac75ef2b02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:57.909709 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e0d4e-5653-4ef3-8d8a-3ac75ef2b02a admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:57.910325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e0d4e-5653-4ef3-8d8a-3ac75ef2b02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:57.912216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e0d4e-5653-4ef3-8d8a-3ac75ef2b02a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:57.937981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1346/2683] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:13:57 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:13:57.942175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f53e7-a857-426e-a30b-f76db12c884c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:57.952691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f53e7-a857-426e-a30b-f76db12c884c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:58.009869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b60018-719a-4658-9a10-c9da0dabf61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:58.010476 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b60018-719a-4658-9a10-c9da0dabf61f admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:58.010753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b60018-719a-4658-9a10-c9da0dabf61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:58.011023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b60018-719a-4658-9a10-c9da0dabf61f admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:58.011630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b60018-719a-4658-9a10-c9da0dabf61f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:58.013563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b60018-719a-4658-9a10-c9da0dabf61f admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:58.034108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1338/2684] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:13:57 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:13:58.038057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0d4e-5653-4ef3-8d8a-3ac75ef2b02a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:58.048257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e0d4e-5653-4ef3-8d8a-3ac75ef2b02a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:58.052885 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505fc38-f5af-4331-bf7e-65d74b45b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:58.053477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fc38-f5af-4331-bf7e-65d74b45b58b admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:58.053760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fc38-f5af-4331-bf7e-65d74b45b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:58.054040 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fc38-f5af-4331-bf7e-65d74b45b58b admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:58.054678 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505fc38-f5af-4331-bf7e-65d74b45b58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:58.056265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505fc38-f5af-4331-bf7e-65d74b45b58b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:58.066558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1347/2685] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:13:58.070366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b60018-719a-4658-9a10-c9da0dabf61f admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:58.080431 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b60018-719a-4658-9a10-c9da0dabf61f admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:58.084975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8cb73-e646-4714-adc3-20ae603b7c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:58.085613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8cb73-e646-4714-adc3-20ae603b7c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:58.085889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8cb73-e646-4714-adc3-20ae603b7c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:58.086158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8cb73-e646-4714-adc3-20ae603b7c8e admin admin] PATH_INFO: `/v3/projects/5231048b71754a57ae3f7696eddf2e0c/users/4b3f7a7ec94d4da992d8e609723e9053/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:58.089172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:58.103234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8cb73-e646-4714-adc3-20ae603b7c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5231048b71754a57ae3f7696eddf2e0c, user_id=4b3f7a7ec94d4da992d8e609723e9053, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:58.105929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8cb73-e646-4714-adc3-20ae603b7c8e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:58.120820 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1339/2686] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:13:58 2022] PUT /identity/v3/projects/5231048b71754a57ae3f7696eddf2e0c/users/4b3f7a7ec94d4da992d8e609723e9053/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:58.124685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505fc38-f5af-4331-bf7e-65d74b45b58b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:58.134791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505fc38-f5af-4331-bf7e-65d74b45b58b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:58.189382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1fbae-1d93-438c-baf9-593f480f5d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:58.189993 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1fbae-1d93-438c-baf9-593f480f5d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:58.190277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1fbae-1d93-438c-baf9-593f480f5d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:58.190558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1fbae-1d93-438c-baf9-593f480f5d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:58.191189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1fbae-1d93-438c-baf9-593f480f5d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:58.192800 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1fbae-1d93-438c-baf9-593f480f5d25 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:58.202284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1348/2687] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:13:58.207154 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8cb73-e646-4714-adc3-20ae603b7c8e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:58.217523 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8cb73-e646-4714-adc3-20ae603b7c8e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:58.222648 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d335f-975e-4456-b77b-ca691747fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:58.223289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d335f-975e-4456-b77b-ca691747fea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:58.223569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d335f-975e-4456-b77b-ca691747fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:58.223843 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d335f-975e-4456-b77b-ca691747fea3 admin admin] PATH_INFO: `/v3/projects/5231048b71754a57ae3f7696eddf2e0c/users/4b3f7a7ec94d4da992d8e609723e9053/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:58.225739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d335f-975e-4456-b77b-ca691747fea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5231048b71754a57ae3f7696eddf2e0c, user_id=4b3f7a7ec94d4da992d8e609723e9053, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:58.228317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d335f-975e-4456-b77b-ca691747fea3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:58.238194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1340/2688] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:13:58 2022] PUT /identity/v3/projects/5231048b71754a57ae3f7696eddf2e0c/users/4b3f7a7ec94d4da992d8e609723e9053/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:58.248190 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6049-a4e1-480f-837b-9ce254ebd04b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:58.248504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6049-a4e1-480f-837b-9ce254ebd04b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:58.248793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6049-a4e1-480f-837b-9ce254ebd04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:58.276235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3a9d6049-a4e1-480f-837b-9ce254ebd04b None None] MFA Rules not processed for user `4b3f7a7ec94d4da992d8e609723e9053`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:58.277512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3a9d6049-a4e1-480f-837b-9ce254ebd04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:58.315739 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:58.347497 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1349/2689] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:58 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:58.358933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d335f-975e-4456-b77b-ca691747fea3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:58.360609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7f1d335f-975e-4456-b77b-ca691747fea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:58.416360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d335f-975e-4456-b77b-ca691747fea3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:58.419971 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a984da-51f4-4948-914e-a0d0bc59e152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:58.420607 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a984da-51f4-4948-914e-a0d0bc59e152 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:58.420889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a984da-51f4-4948-914e-a0d0bc59e152 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:58.421162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a984da-51f4-4948-914e-a0d0bc59e152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:58.429939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a984da-51f4-4948-914e-a0d0bc59e152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:58.431362 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a984da-51f4-4948-914e-a0d0bc59e152 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:58.441168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1341/2690] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:13:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:13:58.575707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6049-a4e1-480f-837b-9ce254ebd04b None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:58.638078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6049-a4e1-480f-837b-9ce254ebd04b None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:58.643419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:58.644090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:58.644373 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:58.644677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] PATH_INFO: `/v3/users/bd5e19a770b741ecb0034b3274aa67b7` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:58.645804 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5e19a770b741ecb0034b3274aa67b7)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:58.647717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:58.693886 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5e19a770b741ecb0034b3274aa67b7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:58.694537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5e19a770b741ecb0034b3274aa67b7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:58.707201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5e19a770b741ecb0034b3274aa67b7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:58.713991 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5e19a770b741ecb0034b3274aa67b7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:58.714924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5e19a770b741ecb0034b3274aa67b7'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:58.727539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1350/2691] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:13:58 2022] DELETE /identity/v3/users/bd5e19a770b741ecb0034b3274aa67b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:58.731960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7c0fd-87dd-4023-9ee1-8cdc684ed288 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:58.732252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7c0fd-87dd-4023-9ee1-8cdc684ed288 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:58.732591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7c0fd-87dd-4023-9ee1-8cdc684ed288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:58.752862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d9c7c0fd-87dd-4023-9ee1-8cdc684ed288 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:58.754057 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d9c7c0fd-87dd-4023-9ee1-8cdc684ed288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:58.811451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1342/2692] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:58.821952 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:58.823390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:58.879845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee055-b2d5-472c-ac60-6cc83e4e9bd9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:58.883465 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c94b-badb-4f8d-a36d-e331fca564c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:58.884071 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c94b-badb-4f8d-a36d-e331fca564c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:58.884349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c94b-badb-4f8d-a36d-e331fca564c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:58.884656 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c94b-badb-4f8d-a36d-e331fca564c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:58.891512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:58.893755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723c94b-badb-4f8d-a36d-e331fca564c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:58.895644 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723c94b-badb-4f8d-a36d-e331fca564c6 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:58.906192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1351/2693] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:13:59.167515 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7c0fd-87dd-4023-9ee1-8cdc684ed288 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:59.169212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d9c7c0fd-87dd-4023-9ee1-8cdc684ed288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:59.181994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7c0fd-87dd-4023-9ee1-8cdc684ed288 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:59.186740 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:59.187391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:59.187709 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:59.187989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] PATH_INFO: `/v3/projects/2c7a64a0bede48379031af2ca1b53da2` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:59.189135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7a64a0bede48379031af2ca1b53da2)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:59.191035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:59.237415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7a64a0bede48379031af2ca1b53da2', 'request_id': 'req-aa5be388-170c-447a-b164-60bee509b4dc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.243391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7a64a0bede48379031af2ca1b53da2', 'request_id': 'req-aa5be388-170c-447a-b164-60bee509b4dc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.250539 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7a64a0bede48379031af2ca1b53da2', 'request_id': 'req-aa5be388-170c-447a-b164-60bee509b4dc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.256992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:59.262379 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] The token cache is being invalidate because project 2c7a64a0bede48379031af2ca1b53da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:13:59.262994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.263668 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.265287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1343/2694] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:13:59 2022] DELETE /identity/v3/projects/2c7a64a0bede48379031af2ca1b53da2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:59.269231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c94b-badb-4f8d-a36d-e331fca564c6 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:59.279105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c94b-badb-4f8d-a36d-e331fca564c6 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:59.341530 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:59.342167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:59.342449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:59.342728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] PATH_INFO: `/v3/users/4b3f7a7ec94d4da992d8e609723e9053` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:59.344346 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3f7a7ec94d4da992d8e609723e9053)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:59.346325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:59.390013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3f7a7ec94d4da992d8e609723e9053'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.390672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3f7a7ec94d4da992d8e609723e9053'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.402701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3f7a7ec94d4da992d8e609723e9053'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.409933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3f7a7ec94d4da992d8e609723e9053'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.410630 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9f7944ff-6114-40c8-9317-6cc2d00cbe64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3f7a7ec94d4da992d8e609723e9053'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.423364 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1352/2695] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:13:59 2022] DELETE /identity/v3/users/4b3f7a7ec94d4da992d8e609723e9053 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:13:59.694908 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:59.696352 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:59.710787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5be388-170c-447a-b164-60bee509b4dc admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:59.772970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:59.773615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:59.773867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:59.774141 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] PATH_INFO: `/v3/projects/5231048b71754a57ae3f7696eddf2e0c` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:59.775246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5231048b71754a57ae3f7696eddf2e0c)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:59.777166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:13:59.822472 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5231048b71754a57ae3f7696eddf2e0c', 'request_id': 'req-16fe1303-1858-4906-b15e-a74d938da095'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.828435 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5231048b71754a57ae3f7696eddf2e0c', 'request_id': 'req-16fe1303-1858-4906-b15e-a74d938da095'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.835292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5231048b71754a57ae3f7696eddf2e0c', 'request_id': 'req-16fe1303-1858-4906-b15e-a74d938da095'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.845968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] The token cache is being invalidate because project 5231048b71754a57ae3f7696eddf2e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:13:59.846250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.846870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-16fe1303-1858-4906-b15e-a74d938da095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:13:59.848324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1344/2696] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:13:59 2022] DELETE /identity/v3/projects/5231048b71754a57ae3f7696eddf2e0c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:13:59.853178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50992-cc97-42df-ae81-5117811fccc0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:59.853682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50992-cc97-42df-ae81-5117811fccc0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:59.853788 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e50992-cc97-42df-ae81-5117811fccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:59.873983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-40e50992-cc97-42df-ae81-5117811fccc0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:59.875210 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-40e50992-cc97-42df-ae81-5117811fccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:59.934379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1353/2697] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:59.942130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d9f02-8d01-4b69-871c-6e0b512d1e96 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:59.942353 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d9f02-8d01-4b69-871c-6e0b512d1e96 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:59.942629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d9f02-8d01-4b69-871c-6e0b512d1e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:59.961679 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7a1d9f02-8d01-4b69-871c-6e0b512d1e96 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:13:59.962877 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7a1d9f02-8d01-4b69-871c-6e0b512d1e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:13:59.971594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1345/2698] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:13:59.975708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e50992-cc97-42df-ae81-5117811fccc0 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:13:59.985980 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e50992-cc97-42df-ae81-5117811fccc0 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:13:59.990551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7b3e-c5d1-452d-992d-d2b0396b7cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:13:59.991140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7b3e-c5d1-452d-992d-d2b0396b7cda admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:13:59.991418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7b3e-c5d1-452d-992d-d2b0396b7cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:13:59.991690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7b3e-c5d1-452d-992d-d2b0396b7cda admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:13:59.992359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d7b3e-c5d1-452d-992d-d2b0396b7cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:13:59.992690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d7b3e-c5d1-452d-992d-d2b0396b7cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:13:59.994267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d7b3e-c5d1-452d-992d-d2b0396b7cda admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:00.006086 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1354/2699] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:14:00.010186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d9f02-8d01-4b69-871c-6e0b512d1e96 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:00.019956 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d9f02-8d01-4b69-871c-6e0b512d1e96 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:00.024542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7483b5-712a-4d9f-bafa-f118d61bafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:00.025135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7483b5-712a-4d9f-bafa-f118d61bafcd admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:00.025415 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7483b5-712a-4d9f-bafa-f118d61bafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:00.025688 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7483b5-712a-4d9f-bafa-f118d61bafcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:00.026306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7483b5-712a-4d9f-bafa-f118d61bafcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:00.028173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7483b5-712a-4d9f-bafa-f118d61bafcd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:00.063544 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1346/2700] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:14:00 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:14:00.067576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7b3e-c5d1-452d-992d-d2b0396b7cda admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:00.072758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:00.079164 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7b3e-c5d1-452d-992d-d2b0396b7cda admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:00.137264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a40d41-436d-479d-b112-a4ca7999552a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:00.137870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a40d41-436d-479d-b112-a4ca7999552a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:00.138149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a40d41-436d-479d-b112-a4ca7999552a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:00.138424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a40d41-436d-479d-b112-a4ca7999552a admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:00.139038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a40d41-436d-479d-b112-a4ca7999552a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:00.141540 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a40d41-436d-479d-b112-a4ca7999552a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:00.161129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1355/2701] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:14:00 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:14:00.165241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7483b5-712a-4d9f-bafa-f118d61bafcd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:00.175626 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7483b5-712a-4d9f-bafa-f118d61bafcd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:00.180275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fd20a-1f7e-4aa5-93af-849c60844d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:00.180907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fd20a-1f7e-4aa5-93af-849c60844d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:00.181190 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fd20a-1f7e-4aa5-93af-849c60844d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:00.181463 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fd20a-1f7e-4aa5-93af-849c60844d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:00.182097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fd20a-1f7e-4aa5-93af-849c60844d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:00.183682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fd20a-1f7e-4aa5-93af-849c60844d47 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:00.194213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1347/2702] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:14:00.197878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a40d41-436d-479d-b112-a4ca7999552a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:00.208267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a40d41-436d-479d-b112-a4ca7999552a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:00.212842 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516935e-f591-4d94-a704-8759814b14e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:00.213425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516935e-f591-4d94-a704-8759814b14e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:00.213705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516935e-f591-4d94-a704-8759814b14e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:00.213979 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516935e-f591-4d94-a704-8759814b14e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:00.214856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516935e-f591-4d94-a704-8759814b14e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:00.216494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516935e-f591-4d94-a704-8759814b14e5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:00.227056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1356/2703] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:14:00.230946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fd20a-1f7e-4aa5-93af-849c60844d47 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:00.241413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fd20a-1f7e-4aa5-93af-849c60844d47 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:00.245981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72304e4a-487c-444e-9264-1c429c31b48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:00.246630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304e4a-487c-444e-9264-1c429c31b48b admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:00.246917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304e4a-487c-444e-9264-1c429c31b48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:00.247193 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304e4a-487c-444e-9264-1c429c31b48b admin admin] PATH_INFO: `/v3/projects/71435ff8b01b4bd1affa1d832acf4f08/users/fae3f162efad41e095c8996ea38de5db/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:00.262469 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72304e4a-487c-444e-9264-1c429c31b48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71435ff8b01b4bd1affa1d832acf4f08, user_id=fae3f162efad41e095c8996ea38de5db, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:00.265166 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72304e4a-487c-444e-9264-1c429c31b48b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:00.277532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1348/2704] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:14:00 2022] PUT /identity/v3/projects/71435ff8b01b4bd1affa1d832acf4f08/users/fae3f162efad41e095c8996ea38de5db/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:14:00.287819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ef29f-741e-4ef5-9b1b-8891f9e33c4c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:00.288108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ef29f-741e-4ef5-9b1b-8891f9e33c4c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:00.288388 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ef29f-741e-4ef5-9b1b-8891f9e33c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:00.316055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-0e4ef29f-741e-4ef5-9b1b-8891f9e33c4c None None] MFA Rules not processed for user `fae3f162efad41e095c8996ea38de5db`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:00.317298 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-0e4ef29f-741e-4ef5-9b1b-8891f9e33c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:00.381213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1357/2705] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:14:00.392351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72304e4a-487c-444e-9264-1c429c31b48b admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:00.394124 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-72304e4a-487c-444e-9264-1c429c31b48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:00.412085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:00.452025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72304e4a-487c-444e-9264-1c429c31b48b admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:00.455583 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bba29-170d-4166-8baf-bac654f4f907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:00.456182 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bba29-170d-4166-8baf-bac654f4f907 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:00.456469 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bba29-170d-4166-8baf-bac654f4f907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:00.456752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bba29-170d-4166-8baf-bac654f4f907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:00.464994 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bba29-170d-4166-8baf-bac654f4f907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:00.466403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bba29-170d-4166-8baf-bac654f4f907 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:00.474948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1349/2706] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:14:00.494485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ef29f-741e-4ef5-9b1b-8891f9e33c4c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:00.554156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ef29f-741e-4ef5-9b1b-8891f9e33c4c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:00.558649 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:00.559267 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:00.559544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:00.559815 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] PATH_INFO: `/v3/users/fae3f162efad41e095c8996ea38de5db` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:00.560961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae3f162efad41e095c8996ea38de5db)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:00.563481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:00.575186 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:00.608716 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae3f162efad41e095c8996ea38de5db'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:00.609389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae3f162efad41e095c8996ea38de5db'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:00.621870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae3f162efad41e095c8996ea38de5db'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:00.628674 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae3f162efad41e095c8996ea38de5db'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:00.629322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae3f162efad41e095c8996ea38de5db'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:00.641614 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1358/2707] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:14:00 2022] DELETE /identity/v3/users/fae3f162efad41e095c8996ea38de5db => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:14:00.646209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f29ff-31af-41ad-9562-764a6004f65f None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:00.646492 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f29ff-31af-41ad-9562-764a6004f65f None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:00.646763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f29ff-31af-41ad-9562-764a6004f65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:00.665554 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0f5f29ff-31af-41ad-9562-764a6004f65f None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:00.666738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0f5f29ff-31af-41ad-9562-764a6004f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:00.726134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1350/2708] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:00.733202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:00.735209 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:00.791418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1d53f-d71c-4c87-adf0-9c715ab22e80 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:00.795248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebd623-4529-4d4d-b496-132cb0099062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:00.795862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebd623-4529-4d4d-b496-132cb0099062 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:00.796144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebd623-4529-4d4d-b496-132cb0099062 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:00.796419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebd623-4529-4d4d-b496-132cb0099062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:00.806085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebd623-4529-4d4d-b496-132cb0099062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:00.807517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebd623-4529-4d4d-b496-132cb0099062 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:00.816971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1359/2709] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:14:01.081258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f29ff-31af-41ad-9562-764a6004f65f None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:01.082690 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0f5f29ff-31af-41ad-9562-764a6004f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:01.099060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f29ff-31af-41ad-9562-764a6004f65f None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:01.105083 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:01.105938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.106349 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.106697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] PATH_INFO: `/v3/projects/71435ff8b01b4bd1affa1d832acf4f08` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.107891 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71435ff8b01b4bd1affa1d832acf4f08)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:01.109785 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:01.155358 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71435ff8b01b4bd1affa1d832acf4f08', 'request_id': 'req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:01.162056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71435ff8b01b4bd1affa1d832acf4f08', 'request_id': 'req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:01.168721 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71435ff8b01b4bd1affa1d832acf4f08', 'request_id': 'req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:01.179304 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] The token cache is being invalidate because project 71435ff8b01b4bd1affa1d832acf4f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:14:01.179586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:01.180224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bbacd7ed-92e7-4cae-9b69-06c9efc522f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:01.182493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1351/2710] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:14:01 2022] DELETE /identity/v3/projects/71435ff8b01b4bd1affa1d832acf4f08 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:14:01.187501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f381-f507-4ff4-a6a1-33a2e7a9d79e None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.188591 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f381-f507-4ff4-a6a1-33a2e7a9d79e None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.188733 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f381-f507-4ff4-a6a1-33a2e7a9d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.209161 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-95b6f381-f507-4ff4-a6a1-33a2e7a9d79e None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:01.210358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-95b6f381-f507-4ff4-a6a1-33a2e7a9d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:01.269597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1360/2711] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:01.278294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087bea7-0c91-46a4-bcb3-ecdbbb84a6e8 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.278594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087bea7-0c91-46a4-bcb3-ecdbbb84a6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.278857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087bea7-0c91-46a4-bcb3-ecdbbb84a6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.299219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-9087bea7-0c91-46a4-bcb3-ecdbbb84a6e8 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:01.300478 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-9087bea7-0c91-46a4-bcb3-ecdbbb84a6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:01.308373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1352/2712] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:01.312626 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6f381-f507-4ff4-a6a1-33a2e7a9d79e None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:01.322771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6f381-f507-4ff4-a6a1-33a2e7a9d79e None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:01.327248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b08c47-e111-4931-8189-8fc50f0398f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:01.327839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b08c47-e111-4931-8189-8fc50f0398f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.328113 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b08c47-e111-4931-8189-8fc50f0398f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.328430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b08c47-e111-4931-8189-8fc50f0398f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.329093 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b08c47-e111-4931-8189-8fc50f0398f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:14:01.329395 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b08c47-e111-4931-8189-8fc50f0398f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:01.331079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b08c47-e111-4931-8189-8fc50f0398f7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:01.342731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1361/2713] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:14:01.347619 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087bea7-0c91-46a4-bcb3-ecdbbb84a6e8 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:01.357012 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087bea7-0c91-46a4-bcb3-ecdbbb84a6e8 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:01.362380 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cdd7d-9716-45ea-9113-97befdbde1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:01.362979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cdd7d-9716-45ea-9113-97befdbde1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.363263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cdd7d-9716-45ea-9113-97befdbde1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.363546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cdd7d-9716-45ea-9113-97befdbde1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.364172 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cdd7d-9716-45ea-9113-97befdbde1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:01.366097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cdd7d-9716-45ea-9113-97befdbde1a3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:01.393787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1353/2714] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:14:01 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:14:01.397957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b08c47-e111-4931-8189-8fc50f0398f7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:01.407889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b08c47-e111-4931-8189-8fc50f0398f7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:01.424333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:01.465577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1082fd4-8e8a-4e8d-9276-eff19bd7c34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:01.466168 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1082fd4-8e8a-4e8d-9276-eff19bd7c34b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.466445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1082fd4-8e8a-4e8d-9276-eff19bd7c34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.466717 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1082fd4-8e8a-4e8d-9276-eff19bd7c34b admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.467325 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1082fd4-8e8a-4e8d-9276-eff19bd7c34b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:01.469278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1082fd4-8e8a-4e8d-9276-eff19bd7c34b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:01.489331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1362/2715] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:14:01 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:14:01.493458 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cdd7d-9716-45ea-9113-97befdbde1a3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:01.504285 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cdd7d-9716-45ea-9113-97befdbde1a3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:01.508981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875960-0826-4258-944e-8d2539eff6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:01.509582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875960-0826-4258-944e-8d2539eff6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.509867 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875960-0826-4258-944e-8d2539eff6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.510144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5875960-0826-4258-944e-8d2539eff6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.510813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5875960-0826-4258-944e-8d2539eff6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:01.512397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5875960-0826-4258-944e-8d2539eff6ed admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:01.522878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1354/2716] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:14:01.526595 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1082fd4-8e8a-4e8d-9276-eff19bd7c34b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:01.536713 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1082fd4-8e8a-4e8d-9276-eff19bd7c34b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:01.541215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd496c6-7965-4d94-94d2-e6297b0ddfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:01.541827 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd496c6-7965-4d94-94d2-e6297b0ddfe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.542108 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd496c6-7965-4d94-94d2-e6297b0ddfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.542380 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd496c6-7965-4d94-94d2-e6297b0ddfe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.543011 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd496c6-7965-4d94-94d2-e6297b0ddfe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:01.544613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd496c6-7965-4d94-94d2-e6297b0ddfe3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:01.554985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1363/2717] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:14:01.558933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875960-0826-4258-944e-8d2539eff6ed admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:01.564640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:01.570897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5875960-0826-4258-944e-8d2539eff6ed admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:01.576333 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f4901-b1fa-475c-a908-c3db2eeebbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:01.577009 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f4901-b1fa-475c-a908-c3db2eeebbed admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.577296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f4901-b1fa-475c-a908-c3db2eeebbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.577573 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f4901-b1fa-475c-a908-c3db2eeebbed admin admin] PATH_INFO: `/v3/projects/b2073181ab67467181796b99bc1c7b92/users/1c7564f4b177467b9e77f5694d52f545/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.592622 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f4901-b1fa-475c-a908-c3db2eeebbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2073181ab67467181796b99bc1c7b92, user_id=1c7564f4b177467b9e77f5694d52f545, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:01.595257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f4901-b1fa-475c-a908-c3db2eeebbed admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:01.607157 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1355/2718] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:14:01 2022] PUT /identity/v3/projects/b2073181ab67467181796b99bc1c7b92/users/1c7564f4b177467b9e77f5694d52f545/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:14:01.612091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587ede-2b1a-45d3-8c91-bced32ce4922 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.612378 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587ede-2b1a-45d3-8c91-bced32ce4922 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.612703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587ede-2b1a-45d3-8c91-bced32ce4922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.631542 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-79587ede-2b1a-45d3-8c91-bced32ce4922 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:01.632777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-79587ede-2b1a-45d3-8c91-bced32ce4922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:01.689440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1364/2719] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:01.698731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f4901-b1fa-475c-a908-c3db2eeebbed admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:01.700409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b12f4901-b1fa-475c-a908-c3db2eeebbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:01.758937 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f4901-b1fa-475c-a908-c3db2eeebbed admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:01.762595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b55009-e082-4cf0-b46a-e6c8f26a1b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:01.763207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b55009-e082-4cf0-b46a-e6c8f26a1b41 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:01.763493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b55009-e082-4cf0-b46a-e6c8f26a1b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:01.763770 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b55009-e082-4cf0-b46a-e6c8f26a1b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:01.772696 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b55009-e082-4cf0-b46a-e6c8f26a1b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:01.774179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b55009-e082-4cf0-b46a-e6c8f26a1b41 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:01.783524 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1356/2720] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:14:02.409521 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd4deb-8198-4519-b558-c6a39417b9ae None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:02.410062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd4deb-8198-4519-b558-c6a39417b9ae None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:02.410062 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd4deb-8198-4519-b558-c6a39417b9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:02.437776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-05fd4deb-8198-4519-b558-c6a39417b9ae None None] MFA Rules not processed for user `1c7564f4b177467b9e77f5694d52f545`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:02.439255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-05fd4deb-8198-4519-b558-c6a39417b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:02.508501 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1365/2721] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:02.519693 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b55009-e082-4cf0-b46a-e6c8f26a1b41 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:02.521279 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-04b55009-e082-4cf0-b46a-e6c8f26a1b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:02.577263 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b55009-e082-4cf0-b46a-e6c8f26a1b41 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:02.581433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24646206-e40b-4513-a10d-041045e999a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:02.582039 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24646206-e40b-4513-a10d-041045e999a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:02.582316 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24646206-e40b-4513-a10d-041045e999a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:02.582584 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24646206-e40b-4513-a10d-041045e999a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:02.592196 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24646206-e40b-4513-a10d-041045e999a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:02.593637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24646206-e40b-4513-a10d-041045e999a9 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:02.602923 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1357/2722] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:14:03.949329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d062-1a79-4ce2-b4f7-df262958fd86 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:03.949867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d062-1a79-4ce2-b4f7-df262958fd86 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:03.949867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d062-1a79-4ce2-b4f7-df262958fd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:03.969250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f643d062-1a79-4ce2-b4f7-df262958fd86 None None] MFA Rules not processed for user `1c7564f4b177467b9e77f5694d52f545`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:03.970473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f643d062-1a79-4ce2-b4f7-df262958fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:03.977331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1366/2723] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:04.523345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24646206-e40b-4513-a10d-041045e999a9 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:04.533255 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24646206-e40b-4513-a10d-041045e999a9 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:04.536918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313618c-6645-427f-9d6c-b5bda5b1a96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:04.537608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313618c-6645-427f-9d6c-b5bda5b1a96b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:04.537958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313618c-6645-427f-9d6c-b5bda5b1a96b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:04.538306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313618c-6645-427f-9d6c-b5bda5b1a96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:04.540093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b313618c-6645-427f-9d6c-b5bda5b1a96b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:04.613572 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313618c-6645-427f-9d6c-b5bda5b1a96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:04.614875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313618c-6645-427f-9d6c-b5bda5b1a96b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:04.626627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1358/2724] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:14:05.733429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643d062-1a79-4ce2-b4f7-df262958fd86 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:05.735472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f643d062-1a79-4ce2-b4f7-df262958fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:05.748426 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643d062-1a79-4ce2-b4f7-df262958fd86 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:05.752722 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3711e9-4a83-49d4-9985-af3b1b79b935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:05.753333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3711e9-4a83-49d4-9985-af3b1b79b935 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:05.753612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3711e9-4a83-49d4-9985-af3b1b79b935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:05.753880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3711e9-4a83-49d4-9985-af3b1b79b935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:05.755560 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4b3711e9-4a83-49d4-9985-af3b1b79b935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:05.769620 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3711e9-4a83-49d4-9985-af3b1b79b935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:05.771040 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3711e9-4a83-49d4-9985-af3b1b79b935 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:05.783566 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1367/2725] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:14:14.621186 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:15.778755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:20.499781 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf486d0d-6e65-47a8-88ca-7075f65a5205 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:20.500289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf486d0d-6e65-47a8-88ca-7075f65a5205 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:20.500391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf486d0d-6e65-47a8-88ca-7075f65a5205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:20.519325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-bf486d0d-6e65-47a8-88ca-7075f65a5205 None None] MFA Rules not processed for user `1c7564f4b177467b9e77f5694d52f545`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:20.520529 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bf486d0d-6e65-47a8-88ca-7075f65a5205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:20.527167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1359/2726] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:30.513743 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:37.705856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac2ba8-d6f5-46ce-9dde-a6a67cf34920 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:37.706432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac2ba8-d6f5-46ce-9dde-a6a67cf34920 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:37.706432 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac2ba8-d6f5-46ce-9dde-a6a67cf34920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:37.731612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3bac2ba8-d6f5-46ce-9dde-a6a67cf34920 None None] MFA Rules not processed for user `66336287be114a8190fc3964f423bbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:37.732858 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3bac2ba8-d6f5-46ce-9dde-a6a67cf34920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:37.791018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1368/2727] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:38.710625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fd243-e95d-48da-9ce5-d984d53c7031 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:38.711514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fd243-e95d-48da-9ce5-d984d53c7031 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:38.711831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fd243-e95d-48da-9ce5-d984d53c7031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:38.770627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d66fd243-e95d-48da-9ce5-d984d53c7031 None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:38.771838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d66fd243-e95d-48da-9ce5-d984d53c7031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:38.840561 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1360/2728] 10.222.0.81 () {58 vars in 1009 bytes} [Thu Aug 18 17:14:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:38.887474 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac2ba8-d6f5-46ce-9dde-a6a67cf34920 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:38.888958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3bac2ba8-d6f5-46ce-9dde-a6a67cf34920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:38.987466 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac2ba8-d6f5-46ce-9dde-a6a67cf34920 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:38.993359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070629c6-5c3a-463e-94f8-993c24cbfc87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:38.993984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070629c6-5c3a-463e-94f8-993c24cbfc87 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:38.994264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070629c6-5c3a-463e-94f8-993c24cbfc87 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:38.994536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070629c6-5c3a-463e-94f8-993c24cbfc87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:39.002941 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070629c6-5c3a-463e-94f8-993c24cbfc87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:39.004647 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070629c6-5c3a-463e-94f8-993c24cbfc87 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:39.012584 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1369/2729] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:14:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:14:40.256562 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fd243-e95d-48da-9ce5-d984d53c7031 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:40.271617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fd243-e95d-48da-9ce5-d984d53c7031 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:40.278926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2dcac-8d3f-4028-b51c-e229657ee02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:40.280281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2dcac-8d3f-4028-b51c-e229657ee02b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:40.280764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2dcac-8d3f-4028-b51c-e229657ee02b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:40.281227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2dcac-8d3f-4028-b51c-e229657ee02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:40.284001 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-abf2dcac-8d3f-4028-b51c-e229657ee02b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:40.296871 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2dcac-8d3f-4028-b51c-e229657ee02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:40.298625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2dcac-8d3f-4028-b51c-e229657ee02b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:40.312852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1361/2730] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:14:49.009407 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=66 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:50.306301 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=46 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:52.033189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070629c6-5c3a-463e-94f8-993c24cbfc87 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:52.035428 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-070629c6-5c3a-463e-94f8-993c24cbfc87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:52.056558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070629c6-5c3a-463e-94f8-993c24cbfc87 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:52.063882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36884b-e01f-4880-aba4-f09de45d016f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:52.065214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36884b-e01f-4880-aba4-f09de45d016f service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:52.066229 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36884b-e01f-4880-aba4-f09de45d016f service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:52.067033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36884b-e01f-4880-aba4-f09de45d016f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:52.069424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9d36884b-e01f-4880-aba4-f09de45d016f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:52.086944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36884b-e01f-4880-aba4-f09de45d016f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:52.088763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36884b-e01f-4880-aba4-f09de45d016f service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:52.104901 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1370/2731] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:14:54.455516 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3b469-5f00-4ec9-8b11-c498f9e5efcd None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:54.455976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3b469-5f00-4ec9-8b11-c498f9e5efcd None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:54.456089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3b469-5f00-4ec9-8b11-c498f9e5efcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:54.476273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-a2e3b469-5f00-4ec9-8b11-c498f9e5efcd None None] MFA Rules not processed for user `2b359b4974ab4d91895106a37d32fb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:54.477503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-a2e3b469-5f00-4ec9-8b11-c498f9e5efcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:54.484543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1362/2732] 10.222.0.81 () {58 vars in 967 bytes} [Thu Aug 18 17:14:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:54.496480 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36884b-e01f-4880-aba4-f09de45d016f service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:54.507820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36884b-e01f-4880-aba4-f09de45d016f service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:54.512659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30037a17-a792-4447-a2e4-ff467dc52d72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee382ab3c8945f1b39b14b00d9237ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:54.513280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037a17-a792-4447-a2e4-ff467dc52d72 service swift] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:54.513559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037a17-a792-4447-a2e4-ff467dc52d72 service swift] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:54.513835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037a17-a792-4447-a2e4-ff467dc52d72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:54.522166 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30037a17-a792-4447-a2e4-ff467dc52d72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:54.523730 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30037a17-a792-4447-a2e4-ff467dc52d72 service swift] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:54.531679 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1371/2733] 10.222.0.81 () {60 vars in 1384 bytes} [Thu Aug 18 17:14:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 17:14:56.428518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3b469-5f00-4ec9-8b11-c498f9e5efcd None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:56.440761 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3b469-5f00-4ec9-8b11-c498f9e5efcd None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:56.445435 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:56.446058 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:56.446335 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:56.446640 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] PATH_INFO: `/v3/users/1c7564f4b177467b9e77f5694d52f545` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:56.447748 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7564f4b177467b9e77f5694d52f545)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:56.449671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:56.494526 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7564f4b177467b9e77f5694d52f545'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:56.500761 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7564f4b177467b9e77f5694d52f545'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:56.501444 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7564f4b177467b9e77f5694d52f545'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:56.502042 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7564f4b177467b9e77f5694d52f545'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:56.509010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d0816ea6-9f59-458e-86c6-4e60a4223d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7564f4b177467b9e77f5694d52f545'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:56.526297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1363/2734] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:14:56 2022] DELETE /identity/v3/users/1c7564f4b177467b9e77f5694d52f545 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:14:56.695445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30037a17-a792-4447-a2e4-ff467dc52d72 service swift] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:56.705917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30037a17-a792-4447-a2e4-ff467dc52d72 service swift] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:56.765545 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:56.766201 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:56.766510 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:56.766816 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] PATH_INFO: `/v3/projects/b2073181ab67467181796b99bc1c7b92` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:56.767947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2073181ab67467181796b99bc1c7b92)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:56.769905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:56.820341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2073181ab67467181796b99bc1c7b92', 'request_id': 'req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:56.827421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2073181ab67467181796b99bc1c7b92', 'request_id': 'req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:56.833643 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2073181ab67467181796b99bc1c7b92', 'request_id': 'req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:56.844065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] The token cache is being invalidate because project b2073181ab67467181796b99bc1c7b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:14:56.844355 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:56.845008 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-0b4c6394-ffca-4a9c-aa1b-1690cdf8d78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:14:56.846489 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1372/2735] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:14:56 2022] DELETE /identity/v3/projects/b2073181ab67467181796b99bc1c7b92 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:14:56.851833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0514de-945d-45c6-b39a-1235d7db7237 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:56.852121 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0514de-945d-45c6-b39a-1235d7db7237 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:56.852396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0514de-945d-45c6-b39a-1235d7db7237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:56.872093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5a0514de-945d-45c6-b39a-1235d7db7237 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:56.873321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5a0514de-945d-45c6-b39a-1235d7db7237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:56.930343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1364/2736] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:56.937930 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a2bde-ecbb-4764-a9e9-74cbcc0b57e6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:56.938237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a2bde-ecbb-4764-a9e9-74cbcc0b57e6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:56.938516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a2bde-ecbb-4764-a9e9-74cbcc0b57e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:56.957558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a96a2bde-ecbb-4764-a9e9-74cbcc0b57e6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:56.958753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a96a2bde-ecbb-4764-a9e9-74cbcc0b57e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:56.966809 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1373/2737] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:56.971067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0514de-945d-45c6-b39a-1235d7db7237 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:56.981128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0514de-945d-45c6-b39a-1235d7db7237 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:56.985750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc0690-8265-4d2b-bef5-742436f3d44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:56.986347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc0690-8265-4d2b-bef5-742436f3d44d admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:56.986638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc0690-8265-4d2b-bef5-742436f3d44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:56.986901 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc0690-8265-4d2b-bef5-742436f3d44d admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:56.987546 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc0690-8265-4d2b-bef5-742436f3d44d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:14:56.988425 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc0690-8265-4d2b-bef5-742436f3d44d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:56.990045 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc0690-8265-4d2b-bef5-742436f3d44d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:57.001307 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1365/2738] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:14:57.005282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a2bde-ecbb-4764-a9e9-74cbcc0b57e6 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:57.014367 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a2bde-ecbb-4764-a9e9-74cbcc0b57e6 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:57.018973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661274b8-a2f8-4c62-b255-2b1219885fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:57.019559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661274b8-a2f8-4c62-b255-2b1219885fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:57.019868 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661274b8-a2f8-4c62-b255-2b1219885fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:57.020150 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661274b8-a2f8-4c62-b255-2b1219885fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:57.020811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661274b8-a2f8-4c62-b255-2b1219885fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:57.022693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661274b8-a2f8-4c62-b255-2b1219885fcd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:57.049277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1374/2739] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:14:57 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:14:57.053833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc0690-8265-4d2b-bef5-742436f3d44d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:57.063703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc0690-8265-4d2b-bef5-742436f3d44d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:57.110342 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:57.120283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71c13a-07ca-4e89-8ef2-2363f331a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:57.121062 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c13a-07ca-4e89-8ef2-2363f331a1de admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:57.121404 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c13a-07ca-4e89-8ef2-2363f331a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:57.121860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71c13a-07ca-4e89-8ef2-2363f331a1de admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:57.122490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71c13a-07ca-4e89-8ef2-2363f331a1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:57.124399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71c13a-07ca-4e89-8ef2-2363f331a1de admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:57.145499 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1366/2740] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:14:57 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:14:57.149505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661274b8-a2f8-4c62-b255-2b1219885fcd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:57.160537 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661274b8-a2f8-4c62-b255-2b1219885fcd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:57.165663 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d14eb5-4ca3-4afb-9a17-85436d0ff08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:57.166280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d14eb5-4ca3-4afb-9a17-85436d0ff08c admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:57.166557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d14eb5-4ca3-4afb-9a17-85436d0ff08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:57.166832 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d14eb5-4ca3-4afb-9a17-85436d0ff08c admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:57.167467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d14eb5-4ca3-4afb-9a17-85436d0ff08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:57.169089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d14eb5-4ca3-4afb-9a17-85436d0ff08c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:57.179036 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1375/2741] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:14:57.182947 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71c13a-07ca-4e89-8ef2-2363f331a1de admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:57.192836 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71c13a-07ca-4e89-8ef2-2363f331a1de admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:57.197343 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54932e-9d6f-4a28-9a5f-eda69331a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:57.197933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54932e-9d6f-4a28-9a5f-eda69331a3af admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:57.198209 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54932e-9d6f-4a28-9a5f-eda69331a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:57.198481 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54932e-9d6f-4a28-9a5f-eda69331a3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:57.199117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54932e-9d6f-4a28-9a5f-eda69331a3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:57.200801 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54932e-9d6f-4a28-9a5f-eda69331a3af admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:57.213642 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1367/2742] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:14:57.217706 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d14eb5-4ca3-4afb-9a17-85436d0ff08c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:57.228860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d14eb5-4ca3-4afb-9a17-85436d0ff08c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:57.233509 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471ff0-5496-45ba-b2ef-e806c979f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:57.234145 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471ff0-5496-45ba-b2ef-e806c979f1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:57.234425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471ff0-5496-45ba-b2ef-e806c979f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:57.234697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471ff0-5496-45ba-b2ef-e806c979f1d7 admin admin] PATH_INFO: `/v3/projects/c3bea1920d1c489396abea816f9b9337/users/df84f7a71d0649b5a4a88dbf0135176c/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:57.248746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9471ff0-5496-45ba-b2ef-e806c979f1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bea1920d1c489396abea816f9b9337, user_id=df84f7a71d0649b5a4a88dbf0135176c, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:57.251350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9471ff0-5496-45ba-b2ef-e806c979f1d7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:57.259829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:57.265169 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1376/2743] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:14:57 2022] PUT /identity/v3/projects/c3bea1920d1c489396abea816f9b9337/users/df84f7a71d0649b5a4a88dbf0135176c/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:14:57.270660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa8679-a7f5-47fd-884b-6f8994d41817 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:57.270999 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa8679-a7f5-47fd-884b-6f8994d41817 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:57.271287 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa8679-a7f5-47fd-884b-6f8994d41817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:57.290555 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0caa8679-a7f5-47fd-884b-6f8994d41817 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:57.291829 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0caa8679-a7f5-47fd-884b-6f8994d41817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:57.351624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1368/2744] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:57.361211 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471ff0-5496-45ba-b2ef-e806c979f1d7 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:57.362849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d9471ff0-5496-45ba-b2ef-e806c979f1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:57.419093 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471ff0-5496-45ba-b2ef-e806c979f1d7 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:57.422667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9bd53-e066-402a-b6c8-3396477c5f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:57.423273 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9bd53-e066-402a-b6c8-3396477c5f39 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:57.423550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9bd53-e066-402a-b6c8-3396477c5f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:57.423819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9bd53-e066-402a-b6c8-3396477c5f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:57.432450 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9bd53-e066-402a-b6c8-3396477c5f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:57.433893 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9bd53-e066-402a-b6c8-3396477c5f39 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:57.443136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1377/2745] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:14:58.028139 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab8b8-9f63-45ac-a7a9-088c7bd8f44c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:58.028691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab8b8-9f63-45ac-a7a9-088c7bd8f44c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:58.028838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab8b8-9f63-45ac-a7a9-088c7bd8f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:58.055987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7e8ab8b8-9f63-45ac-a7a9-088c7bd8f44c None None] MFA Rules not processed for user `df84f7a71d0649b5a4a88dbf0135176c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:58.057225 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7e8ab8b8-9f63-45ac-a7a9-088c7bd8f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:58.126091 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1369/2746] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:58.137241 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9bd53-e066-402a-b6c8-3396477c5f39 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:58.138690 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-42e9bd53-e066-402a-b6c8-3396477c5f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:58.196159 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9bd53-e066-402a-b6c8-3396477c5f39 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:58.199813 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82744d4-be83-4bea-a3ba-b345d9788490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:58.200423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82744d4-be83-4bea-a3ba-b345d9788490 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:58.200732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82744d4-be83-4bea-a3ba-b345d9788490 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:58.201009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82744d4-be83-4bea-a3ba-b345d9788490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:58.211451 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82744d4-be83-4bea-a3ba-b345d9788490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:58.212961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82744d4-be83-4bea-a3ba-b345d9788490 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:58.221989 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1378/2747] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:14:59.614814 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93001d-4edb-4161-ab3b-e4ce44d39617 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:59.615367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93001d-4edb-4161-ab3b-e4ce44d39617 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:59.615367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93001d-4edb-4161-ab3b-e4ce44d39617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:59.634089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-4f93001d-4edb-4161-ab3b-e4ce44d39617 None None] MFA Rules not processed for user `df84f7a71d0649b5a4a88dbf0135176c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:14:59.635291 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4f93001d-4edb-4161-ab3b-e4ce44d39617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:59.642101 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1370/2748] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:14:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:14:59.876089 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82744d4-be83-4bea-a3ba-b345d9788490 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:14:59.877524 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c82744d4-be83-4bea-a3ba-b345d9788490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:59.891763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82744d4-be83-4bea-a3ba-b345d9788490 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:14:59.896806 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af599c0-16cc-452f-b936-2efb0151bbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:14:59.897415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af599c0-16cc-452f-b936-2efb0151bbcd service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:14:59.897698 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af599c0-16cc-452f-b936-2efb0151bbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:14:59.897974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af599c0-16cc-452f-b936-2efb0151bbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:14:59.899736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4af599c0-16cc-452f-b936-2efb0151bbcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:14:59.909423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af599c0-16cc-452f-b936-2efb0151bbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:14:59.910836 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af599c0-16cc-452f-b936-2efb0151bbcd service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:14:59.918814 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1379/2749] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:14:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:15:00.234489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93001d-4edb-4161-ab3b-e4ce44d39617 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:15:00.235869 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4f93001d-4edb-4161-ab3b-e4ce44d39617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:00.296593 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:00.312914 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93001d-4edb-4161-ab3b-e4ce44d39617 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:15:00.318684 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09212a4-4ddc-440f-b266-d822cf3aaf58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:15:00.319297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09212a4-4ddc-440f-b266-d822cf3aaf58 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:00.319576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09212a4-4ddc-440f-b266-d822cf3aaf58 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:00.319848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09212a4-4ddc-440f-b266-d822cf3aaf58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:00.321624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d09212a4-4ddc-440f-b266-d822cf3aaf58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:00.332816 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09212a4-4ddc-440f-b266-d822cf3aaf58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:15:00.334426 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09212a4-4ddc-440f-b266-d822cf3aaf58 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:15:00.344879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1371/2750] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:15:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:15:02.801909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af599c0-16cc-452f-b936-2efb0151bbcd service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:15:02.803557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4af599c0-16cc-452f-b936-2efb0151bbcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:02.885498 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af599c0-16cc-452f-b936-2efb0151bbcd service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:15:02.891304 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9196a8-f90f-4580-ac86-be1e388752f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:15:02.891954 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9196a8-f90f-4580-ac86-be1e388752f4 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:02.892239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9196a8-f90f-4580-ac86-be1e388752f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:02.892550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9196a8-f90f-4580-ac86-be1e388752f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:02.894322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6e9196a8-f90f-4580-ac86-be1e388752f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:02.906791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9196a8-f90f-4580-ac86-be1e388752f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:15:02.908382 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9196a8-f90f-4580-ac86-be1e388752f4 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:15:02.919625 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1380/2751] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:15:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:15:08.285878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09212a4-4ddc-440f-b266-d822cf3aaf58 service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:15:08.287306 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d09212a4-4ddc-440f-b266-d822cf3aaf58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:08.303069 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09212a4-4ddc-440f-b266-d822cf3aaf58 service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:15:08.308853 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309d440-368c-45b4-99d2-e1a0f144d68a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:15:08.309496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309d440-368c-45b4-99d2-e1a0f144d68a service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:08.309775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309d440-368c-45b4-99d2-e1a0f144d68a service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:08.310063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309d440-368c-45b4-99d2-e1a0f144d68a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:08.312278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e309d440-368c-45b4-99d2-e1a0f144d68a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:08.325072 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309d440-368c-45b4-99d2-e1a0f144d68a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:15:08.326650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309d440-368c-45b4-99d2-e1a0f144d68a service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:15:08.338004 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1372/2752] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:15:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:15:12.915134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:18.333427 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=13 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:33.226581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537863c3-df80-4e04-97cd-84344bf7ee55 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:33.227152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537863c3-df80-4e04-97cd-84344bf7ee55 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:33.227152 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537863c3-df80-4e04-97cd-84344bf7ee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:33.246615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-537863c3-df80-4e04-97cd-84344bf7ee55 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:15:33.247808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-537863c3-df80-4e04-97cd-84344bf7ee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:33.255599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1381/2753] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:15:33.276591 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309d440-368c-45b4-99d2-e1a0f144d68a service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:15:33.288322 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309d440-368c-45b4-99d2-e1a0f144d68a service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:15:33.293777 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b568c8b-a13b-4bdc-ba91-8726dca8fd2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:15:33.294376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b568c8b-a13b-4bdc-ba91-8726dca8fd2c service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:33.294659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b568c8b-a13b-4bdc-ba91-8726dca8fd2c service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:33.294938 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b568c8b-a13b-4bdc-ba91-8726dca8fd2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:33.303207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b568c8b-a13b-4bdc-ba91-8726dca8fd2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:15:33.304922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b568c8b-a13b-4bdc-ba91-8726dca8fd2c service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:15:33.314386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1373/2754] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:15:37.283604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e7c5b-af5c-4b93-bb07-0f8a2f8d247b None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:37.284140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e7c5b-af5c-4b93-bb07-0f8a2f8d247b None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:37.284140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e7c5b-af5c-4b93-bb07-0f8a2f8d247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:37.302953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6a3e7c5b-af5c-4b93-bb07-0f8a2f8d247b None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:15:37.304151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6a3e7c5b-af5c-4b93-bb07-0f8a2f8d247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:37.312359 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1382/2755] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:15:37.329828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b568c8b-a13b-4bdc-ba91-8726dca8fd2c service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:15:37.341922 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b568c8b-a13b-4bdc-ba91-8726dca8fd2c service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:15:37.347376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0f66f-fdf8-43a4-848b-09cf314aebaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:15:37.347968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0f66f-fdf8-43a4-848b-09cf314aebaf service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:37.348249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0f66f-fdf8-43a4-848b-09cf314aebaf service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:37.348627 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0f66f-fdf8-43a4-848b-09cf314aebaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:37.356750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0f66f-fdf8-43a4-848b-09cf314aebaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:15:37.358393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0f66f-fdf8-43a4-848b-09cf314aebaf service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:15:37.367665 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1374/2756] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:15:41.554384 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b916785-d10e-43cf-a652-e159508241d6 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:41.554902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b916785-d10e-43cf-a652-e159508241d6 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:41.554902 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b916785-d10e-43cf-a652-e159508241d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:41.574859 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-5b916785-d10e-43cf-a652-e159508241d6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:15:41.576042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5b916785-d10e-43cf-a652-e159508241d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:41.584154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1383/2757] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:15:41.599136 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0f66f-fdf8-43a4-848b-09cf314aebaf service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:15:41.610455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0f66f-fdf8-43a4-848b-09cf314aebaf service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:15:41.616309 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89567b-075d-408f-bef7-aa7ed26e4670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:15:41.617066 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89567b-075d-408f-bef7-aa7ed26e4670 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:41.617315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89567b-075d-408f-bef7-aa7ed26e4670 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:41.617652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89567b-075d-408f-bef7-aa7ed26e4670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:41.625559 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89567b-075d-408f-bef7-aa7ed26e4670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:15:41.627103 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89567b-075d-408f-bef7-aa7ed26e4670 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:15:41.636896 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1375/2758] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:15:45.664452 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce627-1a26-4bfd-9e83-a429106732e0 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:45.664947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce627-1a26-4bfd-9e83-a429106732e0 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:45.665059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce627-1a26-4bfd-9e83-a429106732e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:45.683602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c56ce627-1a26-4bfd-9e83-a429106732e0 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:15:45.684811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c56ce627-1a26-4bfd-9e83-a429106732e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:45.692531 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1384/2759] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:15:45.707625 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89567b-075d-408f-bef7-aa7ed26e4670 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:15:45.719800 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89567b-075d-408f-bef7-aa7ed26e4670 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:15:45.725257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61940e-0dc2-459c-83c9-dd5c67f2452f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:15:45.725855 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61940e-0dc2-459c-83c9-dd5c67f2452f service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:45.726135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61940e-0dc2-459c-83c9-dd5c67f2452f service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:45.726406 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61940e-0dc2-459c-83c9-dd5c67f2452f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:45.734571 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61940e-0dc2-459c-83c9-dd5c67f2452f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:15:45.736125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61940e-0dc2-459c-83c9-dd5c67f2452f service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:15:45.745732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1376/2760] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:15:49.847938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e2387-389a-4691-96ce-b1cbb2653790 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:49.848505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e2387-389a-4691-96ce-b1cbb2653790 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:49.848505 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e2387-389a-4691-96ce-b1cbb2653790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:49.867787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-411e2387-389a-4691-96ce-b1cbb2653790 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:15:49.868988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-411e2387-389a-4691-96ce-b1cbb2653790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:49.876581 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1385/2761] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:15:49.891897 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61940e-0dc2-459c-83c9-dd5c67f2452f service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:15:49.904218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61940e-0dc2-459c-83c9-dd5c67f2452f service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:15:49.909635 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf35559-4b69-4034-aba4-a27ed64d61b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:15:49.910336 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf35559-4b69-4034-aba4-a27ed64d61b1 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:49.910617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf35559-4b69-4034-aba4-a27ed64d61b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:49.910889 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf35559-4b69-4034-aba4-a27ed64d61b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:49.919441 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf35559-4b69-4034-aba4-a27ed64d61b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:15:49.921064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf35559-4b69-4034-aba4-a27ed64d61b1 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:15:49.931251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1377/2762] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:15:54.032147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902de0b-e261-41a5-a50d-3f0eb055e192 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:54.032676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902de0b-e261-41a5-a50d-3f0eb055e192 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:54.032861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902de0b-e261-41a5-a50d-3f0eb055e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:54.051732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-4902de0b-e261-41a5-a50d-3f0eb055e192 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:15:54.052982 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4902de0b-e261-41a5-a50d-3f0eb055e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:15:54.061154 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1386/2763] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:15:54.077250 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf35559-4b69-4034-aba4-a27ed64d61b1 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:15:54.090278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf35559-4b69-4034-aba4-a27ed64d61b1 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:15:54.096022 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e5073-8604-450a-a4f5-d98168b5a3a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:15:54.096660 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e5073-8604-450a-a4f5-d98168b5a3a8 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:15:54.096944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e5073-8604-450a-a4f5-d98168b5a3a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:15:54.097218 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e5073-8604-450a-a4f5-d98168b5a3a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:15:54.105256 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e5073-8604-450a-a4f5-d98168b5a3a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:15:54.106850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e5073-8604-450a-a4f5-d98168b5a3a8 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:15:54.116702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1378/2764] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:16:04.047213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=18 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:04.111970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=36 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:10.129391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88feb75-ab64-4718-91d1-c193b70367f1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:10.129906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88feb75-ab64-4718-91d1-c193b70367f1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:10.130006 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88feb75-ab64-4718-91d1-c193b70367f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:10.148828 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-a88feb75-ab64-4718-91d1-c193b70367f1 None None] MFA Rules not processed for user `df84f7a71d0649b5a4a88dbf0135176c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:16:10.150015 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a88feb75-ab64-4718-91d1-c193b70367f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:16:10.156779 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1387/2765] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:16:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:16:20.144183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:23.951445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65c325-efee-4df6-af21-1badcd2748f2 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:23.952002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65c325-efee-4df6-af21-1badcd2748f2 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:23.952002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65c325-efee-4df6-af21-1badcd2748f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:23.970974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5a65c325-efee-4df6-af21-1badcd2748f2 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:16:23.972253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5a65c325-efee-4df6-af21-1badcd2748f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:16:23.980431 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1379/2766] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:16:23.994488 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88feb75-ab64-4718-91d1-c193b70367f1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:16:24.006987 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88feb75-ab64-4718-91d1-c193b70367f1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:16:24.012290 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f755bea-c62e-4cea-bd93-4f038abf3c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:16:24.012911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755bea-c62e-4cea-bd93-4f038abf3c98 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:24.013189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755bea-c62e-4cea-bd93-4f038abf3c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:24.013462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755bea-c62e-4cea-bd93-4f038abf3c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:24.021358 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f755bea-c62e-4cea-bd93-4f038abf3c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:16:24.022921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f755bea-c62e-4cea-bd93-4f038abf3c98 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:16:24.032256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1388/2767] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:16:27.218219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805d9ed-7d56-4328-a28c-c6b2afbe6c5c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:27.218775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805d9ed-7d56-4328-a28c-c6b2afbe6c5c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:27.218775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805d9ed-7d56-4328-a28c-c6b2afbe6c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:27.237608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-0805d9ed-7d56-4328-a28c-c6b2afbe6c5c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:16:27.238796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-0805d9ed-7d56-4328-a28c-c6b2afbe6c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:16:27.247201 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1380/2768] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:16:27.261582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f755bea-c62e-4cea-bd93-4f038abf3c98 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:16:27.272685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f755bea-c62e-4cea-bd93-4f038abf3c98 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:16:27.278105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf057-dd66-4071-a5f0-ee486b47c824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:16:27.278725 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf057-dd66-4071-a5f0-ee486b47c824 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:27.279033 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf057-dd66-4071-a5f0-ee486b47c824 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:27.279305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf057-dd66-4071-a5f0-ee486b47c824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:27.287254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bf057-dd66-4071-a5f0-ee486b47c824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:16:27.288918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bf057-dd66-4071-a5f0-ee486b47c824 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:16:27.298175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1389/2769] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:16:30.295446 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2b248-09af-480c-b131-9af0e2d62bc1 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:30.295942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2b248-09af-480c-b131-9af0e2d62bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:30.296054 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2b248-09af-480c-b131-9af0e2d62bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:30.315345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-88b2b248-09af-480c-b131-9af0e2d62bc1 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:16:30.316563 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-88b2b248-09af-480c-b131-9af0e2d62bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:16:30.324907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1381/2770] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:16:30.339640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf057-dd66-4071-a5f0-ee486b47c824 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:16:30.351274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf057-dd66-4071-a5f0-ee486b47c824 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:16:30.356642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219a894-50f8-4d16-a274-f32c3a90868d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:16:30.357236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219a894-50f8-4d16-a274-f32c3a90868d service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:30.357516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219a894-50f8-4d16-a274-f32c3a90868d service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:30.357791 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219a894-50f8-4d16-a274-f32c3a90868d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:30.365866 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219a894-50f8-4d16-a274-f32c3a90868d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:16:30.367913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219a894-50f8-4d16-a274-f32c3a90868d service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:16:30.377238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1390/2771] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:16:34.474970 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce983e8-ad02-400f-986c-ca63018d9fab None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:34.475445 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce983e8-ad02-400f-986c-ca63018d9fab None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:34.475558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce983e8-ad02-400f-986c-ca63018d9fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:34.495518 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-cce983e8-ad02-400f-986c-ca63018d9fab None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:16:34.496753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cce983e8-ad02-400f-986c-ca63018d9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:16:34.504574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1382/2772] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:16:34.518944 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219a894-50f8-4d16-a274-f32c3a90868d service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:16:34.531035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219a894-50f8-4d16-a274-f32c3a90868d service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:16:34.536440 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd615b-ba4c-4b82-b68b-d4a2fc9eca33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:16:34.537101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd615b-ba4c-4b82-b68b-d4a2fc9eca33 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:34.537391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd615b-ba4c-4b82-b68b-d4a2fc9eca33 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:34.537666 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd615b-ba4c-4b82-b68b-d4a2fc9eca33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:34.545799 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd615b-ba4c-4b82-b68b-d4a2fc9eca33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:16:34.547446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd615b-ba4c-4b82-b68b-d4a2fc9eca33 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:16:34.557434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1391/2773] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:16:39.710852 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e41470-32a4-4ef6-ac4c-ba536581581a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:39.711377 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e41470-32a4-4ef6-ac4c-ba536581581a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:39.711505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e41470-32a4-4ef6-ac4c-ba536581581a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:39.731402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-d8e41470-32a4-4ef6-ac4c-ba536581581a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:16:39.732657 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-d8e41470-32a4-4ef6-ac4c-ba536581581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:16:39.745798 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1383/2774] 10.222.0.85 () {58 vars in 1016 bytes} [Thu Aug 18 17:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:16:39.758981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd615b-ba4c-4b82-b68b-d4a2fc9eca33 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:16:39.770239 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd615b-ba4c-4b82-b68b-d4a2fc9eca33 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:16:39.776281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020d4e6-1616-42c0-ab89-1af85519e453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:16:39.776984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d4e6-1616-42c0-ab89-1af85519e453 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:39.777338 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d4e6-1616-42c0-ab89-1af85519e453 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:39.777685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d4e6-1616-42c0-ab89-1af85519e453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:39.785955 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020d4e6-1616-42c0-ab89-1af85519e453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:16:39.787529 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020d4e6-1616-42c0-ab89-1af85519e453 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:16:39.798042 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1392/2775] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:16:49.725833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=15 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:49.793708 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=30 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:52.672543 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531f9d-d27f-4b44-937d-0c1a55cde4bb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:16:52.673142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531f9d-d27f-4b44-937d-0c1a55cde4bb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:16:52.673142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531f9d-d27f-4b44-937d-0c1a55cde4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:16:52.695650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-56531f9d-d27f-4b44-937d-0c1a55cde4bb None None] MFA Rules not processed for user `66336287be114a8190fc3964f423bbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:16:52.697616 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-56531f9d-d27f-4b44-937d-0c1a55cde4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:16:52.763008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1384/2776] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:16:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:17:02.755838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=25 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:11.153230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020d4e6-1616-42c0-ab89-1af85519e453 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:17:11.163833 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020d4e6-1616-42c0-ab89-1af85519e453 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:17:11.168657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:17:11.169284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:17:11.169566 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:17:11.169845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] PATH_INFO: `/v3/users/df84f7a71d0649b5a4a88dbf0135176c` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:17:11.170968 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df84f7a71d0649b5a4a88dbf0135176c)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:17:11.172939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:17:11.220059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df84f7a71d0649b5a4a88dbf0135176c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:17:11.220746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df84f7a71d0649b5a4a88dbf0135176c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:17:11.233118 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df84f7a71d0649b5a4a88dbf0135176c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:17:11.239950 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df84f7a71d0649b5a4a88dbf0135176c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:17:11.240611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df84f7a71d0649b5a4a88dbf0135176c'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:17:11.253401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1393/2777] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:17:11 2022] DELETE /identity/v3/users/df84f7a71d0649b5a4a88dbf0135176c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:17:11.424220 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56531f9d-d27f-4b44-937d-0c1a55cde4bb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:17:11.439917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56531f9d-d27f-4b44-937d-0c1a55cde4bb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:17:11.497991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:17:11.498624 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:17:11.498907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:17:11.499183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] PATH_INFO: `/v3/projects/c3bea1920d1c489396abea816f9b9337` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:17:11.500284 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3bea1920d1c489396abea816f9b9337)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:17:11.502216 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:17:11.546341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3bea1920d1c489396abea816f9b9337', 'request_id': 'req-db330da2-87a6-44e4-a7df-27d16c7c4341'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:17:11.552289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3bea1920d1c489396abea816f9b9337', 'request_id': 'req-db330da2-87a6-44e4-a7df-27d16c7c4341'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:17:11.560021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3bea1920d1c489396abea816f9b9337', 'request_id': 'req-db330da2-87a6-44e4-a7df-27d16c7c4341'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:17:11.570459 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] The token cache is being invalidate because project c3bea1920d1c489396abea816f9b9337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:17:11.570752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:17:11.571370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:17:11.572890 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1385/2778] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:17:11 2022] DELETE /identity/v3/projects/c3bea1920d1c489396abea816f9b9337 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:17:21.249957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:21.567488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:21.961270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:17:21.962711 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:17:22.033342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4edea-973e-4f2a-bb9b-40f8d1e21b4d admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:17:22.091110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866a69f-651f-4187-a7ef-4502cdf503b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:17:22.091983 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866a69f-651f-4187-a7ef-4502cdf503b7 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:17:22.092269 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866a69f-651f-4187-a7ef-4502cdf503b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:17:22.092576 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866a69f-651f-4187-a7ef-4502cdf503b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:17:22.094300 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f866a69f-651f-4187-a7ef-4502cdf503b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:17:22.105342 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866a69f-651f-4187-a7ef-4502cdf503b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:17:22.106911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866a69f-651f-4187-a7ef-4502cdf503b7 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:17:22.117348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1394/2779] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:17:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:17:32.112670 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=58 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:18:31.626792 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:18:31.628443 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:18:31.701068 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330da2-87a6-44e4-a7df-27d16c7c4341 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:18:31.706498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d2d5d-8528-45dd-a953-49cef22281bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:18:31.707095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d2d5d-8528-45dd-a953-49cef22281bc service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:18:31.707373 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d2d5d-8528-45dd-a953-49cef22281bc service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:18:31.707645 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d2d5d-8528-45dd-a953-49cef22281bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:18:31.709366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-387d2d5d-8528-45dd-a953-49cef22281bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:18:31.766399 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d2d5d-8528-45dd-a953-49cef22281bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:18:31.767907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d2d5d-8528-45dd-a953-49cef22281bc service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:18:31.776965 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1386/2780] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:18:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:18:41.772725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=56 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:18:42.676927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0307650-fe6b-445f-a5c9-23d79bc97bc1 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:18:42.677459 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0307650-fe6b-445f-a5c9-23d79bc97bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:18:42.677459 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0307650-fe6b-445f-a5c9-23d79bc97bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:18:42.697181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-f0307650-fe6b-445f-a5c9-23d79bc97bc1 None None] MFA Rules not processed for user `66336287be114a8190fc3964f423bbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:18:42.698394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f0307650-fe6b-445f-a5c9-23d79bc97bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:18:42.705274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1395/2781] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:18:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:18:43.010875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d2d5d-8528-45dd-a953-49cef22281bc service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:18:43.012367 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-387d2d5d-8528-45dd-a953-49cef22281bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:18:43.073764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d2d5d-8528-45dd-a953-49cef22281bc service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:18:43.077234 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a4909-662b-4c7a-8a9b-373536722b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:18:43.077816 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4909-662b-4c7a-8a9b-373536722b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:18:43.078093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4909-662b-4c7a-8a9b-373536722b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:18:43.078363 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4909-662b-4c7a-8a9b-373536722b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:18:43.080013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b38a4909-662b-4c7a-8a9b-373536722b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:18:43.089357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a4909-662b-4c7a-8a9b-373536722b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:18:43.090765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a4909-662b-4c7a-8a9b-373536722b94 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:18:43.099366 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1387/2782] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:18:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:18:52.692255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:18:53.095826 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=26 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:20.662682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0307650-fe6b-445f-a5c9-23d79bc97bc1 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:20.664101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-f0307650-fe6b-445f-a5c9-23d79bc97bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:20.675976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0307650-fe6b-445f-a5c9-23d79bc97bc1 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:20.679479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093e194-763a-4258-849e-bb5fd8ffbbe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:20.680076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093e194-763a-4258-849e-bb5fd8ffbbe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:20.680356 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093e194-763a-4258-849e-bb5fd8ffbbe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:20.680659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093e194-763a-4258-849e-bb5fd8ffbbe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:20.682295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3093e194-763a-4258-849e-bb5fd8ffbbe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:20.691934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093e194-763a-4258-849e-bb5fd8ffbbe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:20.693400 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093e194-763a-4258-849e-bb5fd8ffbbe5 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:20.701263 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1396/2783] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:20:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:20:27.207194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a4909-662b-4c7a-8a9b-373536722b94 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:27.208728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b38a4909-662b-4c7a-8a9b-373536722b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:27.263183 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a4909-662b-4c7a-8a9b-373536722b94 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:27.266727 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ccf8e-56ab-43c7-9578-c67a25334115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:27.267929 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ccf8e-56ab-43c7-9578-c67a25334115 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:27.268208 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ccf8e-56ab-43c7-9578-c67a25334115 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:27.268503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ccf8e-56ab-43c7-9578-c67a25334115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:27.270200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-aa4ccf8e-56ab-43c7-9578-c67a25334115 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:27.284656 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ccf8e-56ab-43c7-9578-c67a25334115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:27.286064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ccf8e-56ab-43c7-9578-c67a25334115 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:27.296865 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1388/2784] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:20:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:20:29.887606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093e194-763a-4258-849e-bb5fd8ffbbe5 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:29.897593 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093e194-763a-4258-849e-bb5fd8ffbbe5 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:29.901247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ac242-d2d4-4260-b41a-052bff6cb14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:29.901846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ac242-d2d4-4260-b41a-052bff6cb14a service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:29.902120 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ac242-d2d4-4260-b41a-052bff6cb14a service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:29.902392 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ac242-d2d4-4260-b41a-052bff6cb14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:29.904121 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-ad4ac242-d2d4-4260-b41a-052bff6cb14a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:29.918285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ac242-d2d4-4260-b41a-052bff6cb14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:29.919685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ac242-d2d4-4260-b41a-052bff6cb14a service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:29.930569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1397/2785] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:20:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:20:34.406537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ccf8e-56ab-43c7-9578-c67a25334115 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:34.420356 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ccf8e-56ab-43c7-9578-c67a25334115 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:34.427830 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a5264-11de-4fac-a056-06c0b1758666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:34.428417 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a5264-11de-4fac-a056-06c0b1758666 service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:34.428835 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a5264-11de-4fac-a056-06c0b1758666 service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:34.429588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a5264-11de-4fac-a056-06c0b1758666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:34.431023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4a7a5264-11de-4fac-a056-06c0b1758666 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:34.444881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a5264-11de-4fac-a056-06c0b1758666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:34.446433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a5264-11de-4fac-a056-06c0b1758666 service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:34.458241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1389/2786] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:20:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:20:39.317550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ac242-d2d4-4260-b41a-052bff6cb14a service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:39.326914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ac242-d2d4-4260-b41a-052bff6cb14a service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:39.330623 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d1730-402d-4f1c-bf51-8e51c21c753a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:39.331252 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d1730-402d-4f1c-bf51-8e51c21c753a service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:39.331535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d1730-402d-4f1c-bf51-8e51c21c753a service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:39.331812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d1730-402d-4f1c-bf51-8e51c21c753a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:39.333613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-da2d1730-402d-4f1c-bf51-8e51c21c753a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:39.400327 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d1730-402d-4f1c-bf51-8e51c21c753a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:39.401793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d1730-402d-4f1c-bf51-8e51c21c753a service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:39.411770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1398/2787] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:20:42.408240 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a5264-11de-4fac-a056-06c0b1758666 service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:42.409813 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4a7a5264-11de-4fac-a056-06c0b1758666 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:42.423857 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a5264-11de-4fac-a056-06c0b1758666 service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:42.432272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd17460-218c-483d-a788-841b8c4ec4f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:42.432934 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd17460-218c-483d-a788-841b8c4ec4f9 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:42.433212 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd17460-218c-483d-a788-841b8c4ec4f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:42.433485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd17460-218c-483d-a788-841b8c4ec4f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:42.435214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cbd17460-218c-483d-a788-841b8c4ec4f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:42.447005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd17460-218c-483d-a788-841b8c4ec4f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:42.448603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd17460-218c-483d-a788-841b8c4ec4f9 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:42.459517 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1390/2788] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:20:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:20:42.469295 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d1730-402d-4f1c-bf51-8e51c21c753a service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:42.470858 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-da2d1730-402d-4f1c-bf51-8e51c21c753a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:42.484617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d1730-402d-4f1c-bf51-8e51c21c753a service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:42.491478 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:42.492192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:42.492579 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:42.492959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] PATH_INFO: `/v3/users/66336287be114a8190fc3964f423bbb1` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:42.494305 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=66336287be114a8190fc3964f423bbb1)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:42.496178 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:42.543165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66336287be114a8190fc3964f423bbb1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:42.543808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66336287be114a8190fc3964f423bbb1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:42.558175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66336287be114a8190fc3964f423bbb1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:42.565890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66336287be114a8190fc3964f423bbb1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:42.566476 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-e6d8e390-96f2-4afd-8d91-dbdacf9df0ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66336287be114a8190fc3964f423bbb1'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:42.578834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1399/2789] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:20:42 2022] DELETE /identity/v3/users/66336287be114a8190fc3964f423bbb1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:20:42.748687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd17460-218c-483d-a788-841b8c4ec4f9 service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:42.759758 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd17460-218c-483d-a788-841b8c4ec4f9 service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:42.815860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:42.816590 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:42.816810 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:42.817085 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] PATH_INFO: `/v3/projects/83e8d1eb8a8d4ee4913b028f34cc6c41` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:42.818203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e8d1eb8a8d4ee4913b028f34cc6c41)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:42.820076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:42.865500 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e8d1eb8a8d4ee4913b028f34cc6c41', 'request_id': 'req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:42.871482 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e8d1eb8a8d4ee4913b028f34cc6c41', 'request_id': 'req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:42.879332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e8d1eb8a8d4ee4913b028f34cc6c41', 'request_id': 'req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:42.889351 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] The token cache is being invalidate because project 83e8d1eb8a8d4ee4913b028f34cc6c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:20:42.889638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:42.890254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4b4a2ff2-8cc9-45f1-8ee2-2d179b9b4765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:42.891712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1391/2790] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:20:42 2022] DELETE /identity/v3/projects/83e8d1eb8a8d4ee4913b028f34cc6c41 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:20:42.896657 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa758b-58b6-4680-bb9c-2f9632f4d27c None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:42.896965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa758b-58b6-4680-bb9c-2f9632f4d27c None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:42.897268 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa758b-58b6-4680-bb9c-2f9632f4d27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:42.904694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:42.919793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-58aa758b-58b6-4680-bb9c-2f9632f4d27c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:20:42.921019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-58aa758b-58b6-4680-bb9c-2f9632f4d27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:42.978548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1400/2791] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:20:42.986880 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30413fc0-16bd-48ad-9828-e3549cde0b0c None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:42.987175 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30413fc0-16bd-48ad-9828-e3549cde0b0c None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:42.987458 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30413fc0-16bd-48ad-9828-e3549cde0b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.002337 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:43.007883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-30413fc0-16bd-48ad-9828-e3549cde0b0c None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:20:43.009597 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-30413fc0-16bd-48ad-9828-e3549cde0b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:43.018623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1392/2792] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:20:43.022757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa758b-58b6-4680-bb9c-2f9632f4d27c None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.032300 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa758b-58b6-4680-bb9c-2f9632f4d27c None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.036793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fed71c-de90-488b-81c3-6d6b8eebc061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.037389 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed71c-de90-488b-81c3-6d6b8eebc061 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.037667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed71c-de90-488b-81c3-6d6b8eebc061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.037939 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed71c-de90-488b-81c3-6d6b8eebc061 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.038731 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fed71c-de90-488b-81c3-6d6b8eebc061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:20:43.039077 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fed71c-de90-488b-81c3-6d6b8eebc061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.040685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fed71c-de90-488b-81c3-6d6b8eebc061 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.051861 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1401/2793] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:20:43.055907 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30413fc0-16bd-48ad-9828-e3549cde0b0c None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.065636 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30413fc0-16bd-48ad-9828-e3549cde0b0c None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.070323 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8827df-cce2-464d-a65e-aee77de2ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.070849 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8827df-cce2-464d-a65e-aee77de2ec45 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.071128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8827df-cce2-464d-a65e-aee77de2ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.071403 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8827df-cce2-464d-a65e-aee77de2ec45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.072035 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8827df-cce2-464d-a65e-aee77de2ec45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.073948 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8827df-cce2-464d-a65e-aee77de2ec45 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.101097 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1393/2794] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:20:43 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:20:43.105130 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fed71c-de90-488b-81c3-6d6b8eebc061 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.114761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fed71c-de90-488b-81c3-6d6b8eebc061 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.169330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45832a87-9f63-4173-a3f4-7cf7c92c48b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.169922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832a87-9f63-4173-a3f4-7cf7c92c48b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.170200 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832a87-9f63-4173-a3f4-7cf7c92c48b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.170473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832a87-9f63-4173-a3f4-7cf7c92c48b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.171090 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45832a87-9f63-4173-a3f4-7cf7c92c48b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.173012 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45832a87-9f63-4173-a3f4-7cf7c92c48b3 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.194527 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1402/2795] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:20:43 2022] POST /identity/v3/users => generated 278 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:20:43.198657 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8827df-cce2-464d-a65e-aee77de2ec45 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.209433 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8827df-cce2-464d-a65e-aee77de2ec45 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.214012 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5e80f-e1c8-49de-baf8-9a541cb5abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.214609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e80f-e1c8-49de-baf8-9a541cb5abf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.214895 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e80f-e1c8-49de-baf8-9a541cb5abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.215174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e80f-e1c8-49de-baf8-9a541cb5abf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.215817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5e80f-e1c8-49de-baf8-9a541cb5abf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.217704 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5e80f-e1c8-49de-baf8-9a541cb5abf3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.227582 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1394/2796] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:20:43.231079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45832a87-9f63-4173-a3f4-7cf7c92c48b3 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.241464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45832a87-9f63-4173-a3f4-7cf7c92c48b3 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.246043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549d7df-68d7-458f-b4eb-341457d48694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.246634 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549d7df-68d7-458f-b4eb-341457d48694 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.246917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549d7df-68d7-458f-b4eb-341457d48694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.247195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549d7df-68d7-458f-b4eb-341457d48694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.247834 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549d7df-68d7-458f-b4eb-341457d48694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.249446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549d7df-68d7-458f-b4eb-341457d48694 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.260412 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1403/2797] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:20:43.264194 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5e80f-e1c8-49de-baf8-9a541cb5abf3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.273887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5e80f-e1c8-49de-baf8-9a541cb5abf3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.278446 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68c37e-c165-465a-9a52-1d7ef32f0944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.279090 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c37e-c165-465a-9a52-1d7ef32f0944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.279391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c37e-c165-465a-9a52-1d7ef32f0944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.279653 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c37e-c165-465a-9a52-1d7ef32f0944 admin admin] PATH_INFO: `/v3/projects/bafa87a10ac0409ebae97190f0530767/users/dbd6fb5501114c559d12710f1c3a7dbd/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.294015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68c37e-c165-465a-9a52-1d7ef32f0944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bafa87a10ac0409ebae97190f0530767, user_id=dbd6fb5501114c559d12710f1c3a7dbd, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.296681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68c37e-c165-465a-9a52-1d7ef32f0944 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.310241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1395/2798] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:20:43 2022] PUT /identity/v3/projects/bafa87a10ac0409ebae97190f0530767/users/dbd6fb5501114c559d12710f1c3a7dbd/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:20:43.321453 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199af8-85c6-4ca6-8439-1372d678d1d8 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.321679 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199af8-85c6-4ca6-8439-1372d678d1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.321961 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4199af8-85c6-4ca6-8439-1372d678d1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.348871 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-c4199af8-85c6-4ca6-8439-1372d678d1d8 None None] MFA Rules not processed for user `dbd6fb5501114c559d12710f1c3a7dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:20:43.350088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c4199af8-85c6-4ca6-8439-1372d678d1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:43.408024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:43.415284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1404/2799] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:20:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:20:43.418493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68c37e-c165-465a-9a52-1d7ef32f0944 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.479219 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68c37e-c165-465a-9a52-1d7ef32f0944 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.483887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9afeb-1077-470e-a21d-cc83770bd564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.484537 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9afeb-1077-470e-a21d-cc83770bd564 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.484818 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9afeb-1077-470e-a21d-cc83770bd564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.485093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9afeb-1077-470e-a21d-cc83770bd564 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.485716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9afeb-1077-470e-a21d-cc83770bd564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.488095 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9afeb-1077-470e-a21d-cc83770bd564 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.513928 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1396/2800] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:20:43 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:20:43.518046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4199af8-85c6-4ca6-8439-1372d678d1d8 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.528577 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4199af8-85c6-4ca6-8439-1372d678d1d8 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.586004 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d460-d45f-4e83-a312-e03834c65bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.586624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d460-d45f-4e83-a312-e03834c65bce admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.586906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d460-d45f-4e83-a312-e03834c65bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.587181 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d460-d45f-4e83-a312-e03834c65bce admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.587823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d460-d45f-4e83-a312-e03834c65bce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.589769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677d460-d45f-4e83-a312-e03834c65bce admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.612851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1405/2801] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:20:43 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:20:43.616983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9afeb-1077-470e-a21d-cc83770bd564 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.629745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9afeb-1077-470e-a21d-cc83770bd564 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.634769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf577a5-04f9-4852-8d07-d40111e1c9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.635402 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf577a5-04f9-4852-8d07-d40111e1c9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.635676 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf577a5-04f9-4852-8d07-d40111e1c9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.635951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf577a5-04f9-4852-8d07-d40111e1c9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.636667 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf577a5-04f9-4852-8d07-d40111e1c9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.638272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf577a5-04f9-4852-8d07-d40111e1c9a0 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.649060 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1397/2802] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:20:43.653286 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d460-d45f-4e83-a312-e03834c65bce admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.663988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d460-d45f-4e83-a312-e03834c65bce admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.668672 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb7388-8ed4-4c3f-bfa5-a84cc8111452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.669333 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7388-8ed4-4c3f-bfa5-a84cc8111452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.669617 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7388-8ed4-4c3f-bfa5-a84cc8111452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.669958 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb7388-8ed4-4c3f-bfa5-a84cc8111452 admin admin] PATH_INFO: `/v3/projects/13d47db00af242ff9a87defac5806aab/users/047056965ca34d3b9d909bf5a9b389b2/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.686468 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb7388-8ed4-4c3f-bfa5-a84cc8111452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d47db00af242ff9a87defac5806aab, user_id=047056965ca34d3b9d909bf5a9b389b2, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.689330 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb7388-8ed4-4c3f-bfa5-a84cc8111452 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.701889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1406/2803] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:20:43 2022] PUT /identity/v3/projects/13d47db00af242ff9a87defac5806aab/users/047056965ca34d3b9d909bf5a9b389b2/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:20:43.705974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf577a5-04f9-4852-8d07-d40111e1c9a0 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.716032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf577a5-04f9-4852-8d07-d40111e1c9a0 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.772943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631167f1-0285-4601-a8bb-f9730c6b607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.773545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631167f1-0285-4601-a8bb-f9730c6b607b admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.773825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631167f1-0285-4601-a8bb-f9730c6b607b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.774094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631167f1-0285-4601-a8bb-f9730c6b607b admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.774722 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631167f1-0285-4601-a8bb-f9730c6b607b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.776298 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631167f1-0285-4601-a8bb-f9730c6b607b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.786556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1398/2804] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:20:43.790782 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb7388-8ed4-4c3f-bfa5-a84cc8111452 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.801535 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb7388-8ed4-4c3f-bfa5-a84cc8111452 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:43.806115 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911d5d6-dfd5-4f75-b5de-2c596a676fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:43.806761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911d5d6-dfd5-4f75-b5de-2c596a676fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.807044 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911d5d6-dfd5-4f75-b5de-2c596a676fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.807322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911d5d6-dfd5-4f75-b5de-2c596a676fbe admin admin] PATH_INFO: `/v3/projects/13d47db00af242ff9a87defac5806aab/users/047056965ca34d3b9d909bf5a9b389b2/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.809248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911d5d6-dfd5-4f75-b5de-2c596a676fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d47db00af242ff9a87defac5806aab, user_id=047056965ca34d3b9d909bf5a9b389b2, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:43.811894 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911d5d6-dfd5-4f75-b5de-2c596a676fbe admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:43.821829 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1407/2805] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:20:43 2022] PUT /identity/v3/projects/13d47db00af242ff9a87defac5806aab/users/047056965ca34d3b9d909bf5a9b389b2/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:20:43.833430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc3a4-f289-4852-a743-5a9e2bd52701 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:43.833691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc3a4-f289-4852-a743-5a9e2bd52701 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:43.833978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfc3a4-f289-4852-a743-5a9e2bd52701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:43.861714 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:43.864974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-29bfc3a4-f289-4852-a743-5a9e2bd52701 None None] MFA Rules not processed for user `047056965ca34d3b9d909bf5a9b389b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:20:43.867026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-29bfc3a4-f289-4852-a743-5a9e2bd52701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:43.933074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1399/2806] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:20:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:20:43.944149 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911d5d6-dfd5-4f75-b5de-2c596a676fbe admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:43.945839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5911d5d6-dfd5-4f75-b5de-2c596a676fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:44.001726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911d5d6-dfd5-4f75-b5de-2c596a676fbe admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:44.005284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3653e-7e8e-4ad7-a659-18d9a1a7ad2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:44.005882 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3653e-7e8e-4ad7-a659-18d9a1a7ad2e service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:44.006158 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3653e-7e8e-4ad7-a659-18d9a1a7ad2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:44.006425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3653e-7e8e-4ad7-a659-18d9a1a7ad2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:44.015016 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3653e-7e8e-4ad7-a659-18d9a1a7ad2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:44.016430 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3653e-7e8e-4ad7-a659-18d9a1a7ad2e service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:44.026092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1408/2807] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:20:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:20:44.100480 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfc3a4-f289-4852-a743-5a9e2bd52701 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:44.110269 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfc3a4-f289-4852-a743-5a9e2bd52701 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:44.113884 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb9b41-e2ab-4cb3-8c30-e51adee425a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:44.114494 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb9b41-e2ab-4cb3-8c30-e51adee425a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:44.114778 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb9b41-e2ab-4cb3-8c30-e51adee425a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:44.115057 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb9b41-e2ab-4cb3-8c30-e51adee425a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:44.170533 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb9b41-e2ab-4cb3-8c30-e51adee425a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:44.171959 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb9b41-e2ab-4cb3-8c30-e51adee425a8 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:44.180700 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1400/2808] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:20:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:20:54.022055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:54.176730 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=56 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:58.862009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3653e-7e8e-4ad7-a659-18d9a1a7ad2e service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:58.922758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3653e-7e8e-4ad7-a659-18d9a1a7ad2e service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:58.927309 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:58.927934 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:58.928216 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:58.928517 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] PATH_INFO: `/v3/users/dbd6fb5501114c559d12710f1c3a7dbd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:58.929645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd6fb5501114c559d12710f1c3a7dbd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:58.931550 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:58.976913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd6fb5501114c559d12710f1c3a7dbd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:58.977590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd6fb5501114c559d12710f1c3a7dbd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:58.989257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd6fb5501114c559d12710f1c3a7dbd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:58.995974 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd6fb5501114c559d12710f1c3a7dbd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:58.996704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd6fb5501114c559d12710f1c3a7dbd'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.008865 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1409/2809] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:20:58 2022] DELETE /identity/v3/users/dbd6fb5501114c559d12710f1c3a7dbd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:20:59.013406 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc1fe1-8fc5-4c67-92f4-ab002b4de510 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:59.013904 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc1fe1-8fc5-4c67-92f4-ab002b4de510 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:59.014013 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc1fe1-8fc5-4c67-92f4-ab002b4de510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:59.032856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-c3cc1fe1-8fc5-4c67-92f4-ab002b4de510 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:20:59.034675 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c3cc1fe1-8fc5-4c67-92f4-ab002b4de510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:59.092170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1401/2810] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:20:59.101701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:59.103116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:59.160419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a46e74-39a1-4d54-a1e0-736f788b1642 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:59.164069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0840dab-cdc4-4625-aa5d-9842abde8255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:59.164701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840dab-cdc4-4625-aa5d-9842abde8255 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:59.164984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840dab-cdc4-4625-aa5d-9842abde8255 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:59.165257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840dab-cdc4-4625-aa5d-9842abde8255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:59.174158 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0840dab-cdc4-4625-aa5d-9842abde8255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:59.175587 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0840dab-cdc4-4625-aa5d-9842abde8255 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:59.184889 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1410/2811] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:20:59.452329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc1fe1-8fc5-4c67-92f4-ab002b4de510 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:59.453787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c3cc1fe1-8fc5-4c67-92f4-ab002b4de510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:59.467497 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc1fe1-8fc5-4c67-92f4-ab002b4de510 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:59.472144 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:59.472806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:59.473596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:59.473881 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] PATH_INFO: `/v3/projects/bafa87a10ac0409ebae97190f0530767` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:59.475168 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bafa87a10ac0409ebae97190f0530767)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:59.477354 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:59.525130 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bafa87a10ac0409ebae97190f0530767', 'request_id': 'req-49c559cb-e64b-47a7-b9bc-052b1f2223c7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.531292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bafa87a10ac0409ebae97190f0530767', 'request_id': 'req-49c559cb-e64b-47a7-b9bc-052b1f2223c7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.542976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bafa87a10ac0409ebae97190f0530767', 'request_id': 'req-49c559cb-e64b-47a7-b9bc-052b1f2223c7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.553981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] The token cache is being invalidate because project bafa87a10ac0409ebae97190f0530767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:20:59.554277 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.554900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.556393 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1402/2812] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:20:59 2022] DELETE /identity/v3/projects/bafa87a10ac0409ebae97190f0530767 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:20:59.560385 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0840dab-cdc4-4625-aa5d-9842abde8255 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:59.570546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0840dab-cdc4-4625-aa5d-9842abde8255 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:20:59.588301 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:20:59.629007 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:20:59.629564 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:20:59.629846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:20:59.630123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] PATH_INFO: `/v3/users/047056965ca34d3b9d909bf5a9b389b2` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:20:59.631236 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] RBAC: Authorizing `identity:delete_user(user_id=047056965ca34d3b9d909bf5a9b389b2)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:20:59.633213 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:20:59.677110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047056965ca34d3b9d909bf5a9b389b2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.677754 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047056965ca34d3b9d909bf5a9b389b2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.690063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047056965ca34d3b9d909bf5a9b389b2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.696808 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047056965ca34d3b9d909bf5a9b389b2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.697446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4ad96f5c-acc4-47e1-980a-3446ad56786c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047056965ca34d3b9d909bf5a9b389b2'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:20:59.709572 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1411/2813] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:20:59 2022] DELETE /identity/v3/users/047056965ca34d3b9d909bf5a9b389b2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:20:59.979596 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:20:59.981071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:20:59.996505 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c559cb-e64b-47a7-b9bc-052b1f2223c7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.053750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.054423 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.054659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.054939 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] PATH_INFO: `/v3/projects/13d47db00af242ff9a87defac5806aab` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.056058 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d47db00af242ff9a87defac5806aab)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.057998 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.087757 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:00.106177 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d47db00af242ff9a87defac5806aab', 'request_id': 'req-19826e7d-dd29-4cb2-9519-5c421773b4c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:00.112689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d47db00af242ff9a87defac5806aab', 'request_id': 'req-19826e7d-dd29-4cb2-9519-5c421773b4c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:00.119691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d47db00af242ff9a87defac5806aab', 'request_id': 'req-19826e7d-dd29-4cb2-9519-5c421773b4c8'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:00.130041 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] The token cache is being invalidate because project 13d47db00af242ff9a87defac5806aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:21:00.130347 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:00.131050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-19826e7d-dd29-4cb2-9519-5c421773b4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:00.132687 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1403/2814] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:20:59 2022] DELETE /identity/v3/projects/13d47db00af242ff9a87defac5806aab => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:00.137551 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34324b1d-310d-4571-a9db-636f07e64fe5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.138026 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34324b1d-310d-4571-a9db-636f07e64fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.138135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34324b1d-310d-4571-a9db-636f07e64fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.157116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-34324b1d-310d-4571-a9db-636f07e64fe5 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:00.158762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-34324b1d-310d-4571-a9db-636f07e64fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:00.216793 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1412/2815] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:00.225118 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d9032-a32d-4312-aa4a-807dae0c0479 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.225411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d9032-a32d-4312-aa4a-807dae0c0479 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.225696 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d9032-a32d-4312-aa4a-807dae0c0479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.244927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-333d9032-a32d-4312-aa4a-807dae0c0479 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:00.246129 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-333d9032-a32d-4312-aa4a-807dae0c0479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:00.253963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1404/2816] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:00.258087 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34324b1d-310d-4571-a9db-636f07e64fe5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.268202 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34324b1d-310d-4571-a9db-636f07e64fe5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.272770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcbbce-6256-4704-af45-b94904904348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.273360 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbbce-6256-4704-af45-b94904904348 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.273637 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbbce-6256-4704-af45-b94904904348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.273909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcbbce-6256-4704-af45-b94904904348 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.274543 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcbbce-6256-4704-af45-b94904904348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:21:00.274844 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcbbce-6256-4704-af45-b94904904348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.276423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcbbce-6256-4704-af45-b94904904348 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.288144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1413/2817] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:21:00.292488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d9032-a32d-4312-aa4a-807dae0c0479 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.301812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d9032-a32d-4312-aa4a-807dae0c0479 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.306520 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86195767-819d-426e-951e-a755210f1022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.307111 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195767-819d-426e-951e-a755210f1022 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.307396 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195767-819d-426e-951e-a755210f1022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.307674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86195767-819d-426e-951e-a755210f1022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.308302 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86195767-819d-426e-951e-a755210f1022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.310270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86195767-819d-426e-951e-a755210f1022 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.337382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1405/2818] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:21:00 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:00.341766 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcbbce-6256-4704-af45-b94904904348 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.352163 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcbbce-6256-4704-af45-b94904904348 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.376769 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:00.409607 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf7456-1180-49a4-bc6c-432638110675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.410142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf7456-1180-49a4-bc6c-432638110675 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.410425 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf7456-1180-49a4-bc6c-432638110675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.410700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf7456-1180-49a4-bc6c-432638110675 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.411319 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf7456-1180-49a4-bc6c-432638110675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.413259 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf7456-1180-49a4-bc6c-432638110675 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.433218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1414/2819] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:21:00 2022] POST /identity/v3/users => generated 304 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:00.437289 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86195767-819d-426e-951e-a755210f1022 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.447717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86195767-819d-426e-951e-a755210f1022 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.452332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b3b4-bd13-4398-af8b-815832d1bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.452973 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b3b4-bd13-4398-af8b-815832d1bc6e admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.453259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b3b4-bd13-4398-af8b-815832d1bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.453538 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b3b4-bd13-4398-af8b-815832d1bc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.454179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119b3b4-bd13-4398-af8b-815832d1bc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.456305 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119b3b4-bd13-4398-af8b-815832d1bc6e admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.466570 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1406/2820] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:00.470031 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf7456-1180-49a4-bc6c-432638110675 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.480292 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf7456-1180-49a4-bc6c-432638110675 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.484990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8867c-173d-45f3-8bd4-19ea798e0968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.485578 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8867c-173d-45f3-8bd4-19ea798e0968 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.485859 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8867c-173d-45f3-8bd4-19ea798e0968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.486134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8867c-173d-45f3-8bd4-19ea798e0968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.486767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8867c-173d-45f3-8bd4-19ea798e0968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.488349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8867c-173d-45f3-8bd4-19ea798e0968 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.497957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1415/2821] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:21:00.501960 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b3b4-bd13-4398-af8b-815832d1bc6e admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.511933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b3b4-bd13-4398-af8b-815832d1bc6e admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.516629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf628da8-113b-434f-862d-dfac83735d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.517275 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf628da8-113b-434f-862d-dfac83735d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.518064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf628da8-113b-434f-862d-dfac83735d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.518345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf628da8-113b-434f-862d-dfac83735d90 admin admin] PATH_INFO: `/v3/projects/c5dcdd12c72f45fbaf9b82a5c87ec778/users/95a73b7519ef4664bd94c2335117118a/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.532698 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf628da8-113b-434f-862d-dfac83735d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5dcdd12c72f45fbaf9b82a5c87ec778, user_id=95a73b7519ef4664bd94c2335117118a, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.535856 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf628da8-113b-434f-862d-dfac83735d90 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.548357 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1407/2822] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:00 2022] PUT /identity/v3/projects/c5dcdd12c72f45fbaf9b82a5c87ec778/users/95a73b7519ef4664bd94c2335117118a/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:00.559860 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49654e-8ea6-4430-b020-e36f633c4b18 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.560144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49654e-8ea6-4430-b020-e36f633c4b18 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.560419 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49654e-8ea6-4430-b020-e36f633c4b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.588017 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-7a49654e-8ea6-4430-b020-e36f633c4b18 None None] MFA Rules not processed for user `95a73b7519ef4664bd94c2335117118a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:00.590092 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7a49654e-8ea6-4430-b020-e36f633c4b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:00.656379 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1416/2823] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:00 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:00.661007 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf628da8-113b-434f-862d-dfac83735d90 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.722413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf628da8-113b-434f-862d-dfac83735d90 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.727221 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c104a-0d75-4e3a-978f-b83dc27d1543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.727884 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c104a-0d75-4e3a-978f-b83dc27d1543 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.728170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c104a-0d75-4e3a-978f-b83dc27d1543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.728549 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c104a-0d75-4e3a-978f-b83dc27d1543 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.729213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c104a-0d75-4e3a-978f-b83dc27d1543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.731210 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c104a-0d75-4e3a-978f-b83dc27d1543 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.758439 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1408/2824] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:21:00 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:00.762503 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49654e-8ea6-4430-b020-e36f633c4b18 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.773546 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49654e-8ea6-4430-b020-e36f633c4b18 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.827909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb9046-c259-4ace-ab95-f12d94e3e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.828570 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb9046-c259-4ace-ab95-f12d94e3e90a admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.828849 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb9046-c259-4ace-ab95-f12d94e3e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.829129 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb9046-c259-4ace-ab95-f12d94e3e90a admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.829746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb9046-c259-4ace-ab95-f12d94e3e90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.832240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb9046-c259-4ace-ab95-f12d94e3e90a admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.855232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1417/2825] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:21:00 2022] POST /identity/v3/users => generated 311 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:00.856329 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c104a-0d75-4e3a-978f-b83dc27d1543 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.866371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c104a-0d75-4e3a-978f-b83dc27d1543 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.871243 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e085-a62c-471e-affe-1dcbe67f3826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.871886 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e085-a62c-471e-affe-1dcbe67f3826 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.872173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e085-a62c-471e-affe-1dcbe67f3826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.872451 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e085-a62c-471e-affe-1dcbe67f3826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.873150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2e085-a62c-471e-affe-1dcbe67f3826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.874745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2e085-a62c-471e-affe-1dcbe67f3826 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.886942 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1409/2826] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:00.890767 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb9046-c259-4ace-ab95-f12d94e3e90a admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.901281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb9046-c259-4ace-ab95-f12d94e3e90a admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.905770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ea17a-6c72-41fa-ad7d-0428376916cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:00.906406 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ea17a-6c72-41fa-ad7d-0428376916cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:00.906682 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ea17a-6c72-41fa-ad7d-0428376916cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:00.906957 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ea17a-6c72-41fa-ad7d-0428376916cc admin admin] PATH_INFO: `/v3/projects/0a9155868fd14f8e886ced391ff3df88/users/14f9c8a205da4710bfad135b6c6500f5/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:00.921399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ea17a-6c72-41fa-ad7d-0428376916cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9155868fd14f8e886ced391ff3df88, user_id=14f9c8a205da4710bfad135b6c6500f5, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:00.924608 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ea17a-6c72-41fa-ad7d-0428376916cc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:00.937218 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1418/2827] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:00 2022] PUT /identity/v3/projects/0a9155868fd14f8e886ced391ff3df88/users/14f9c8a205da4710bfad135b6c6500f5/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:21:00.941662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e085-a62c-471e-affe-1dcbe67f3826 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:00.951603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e085-a62c-471e-affe-1dcbe67f3826 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:00.971262 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:01.010241 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9d8a4-6102-4989-8f7f-c148ea9fcb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:01.010850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9d8a4-6102-4989-8f7f-c148ea9fcb8c admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:01.011135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9d8a4-6102-4989-8f7f-c148ea9fcb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:01.011414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9d8a4-6102-4989-8f7f-c148ea9fcb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:01.012056 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9d8a4-6102-4989-8f7f-c148ea9fcb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:01.013671 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9d8a4-6102-4989-8f7f-c148ea9fcb8c admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:01.023231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1410/2828] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:01.027394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ea17a-6c72-41fa-ad7d-0428376916cc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:01.032997 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:01.039270 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ea17a-6c72-41fa-ad7d-0428376916cc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:01.044250 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55152aef-56ba-424e-b20d-0e811878dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:01.044940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55152aef-56ba-424e-b20d-0e811878dd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:01.045231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55152aef-56ba-424e-b20d-0e811878dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:01.045508 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55152aef-56ba-424e-b20d-0e811878dd00 admin admin] PATH_INFO: `/v3/projects/0a9155868fd14f8e886ced391ff3df88/users/14f9c8a205da4710bfad135b6c6500f5/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:01.047443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55152aef-56ba-424e-b20d-0e811878dd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9155868fd14f8e886ced391ff3df88, user_id=14f9c8a205da4710bfad135b6c6500f5, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:01.050612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55152aef-56ba-424e-b20d-0e811878dd00 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:01.060655 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1419/2829] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:01 2022] PUT /identity/v3/projects/0a9155868fd14f8e886ced391ff3df88/users/14f9c8a205da4710bfad135b6c6500f5/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:01.071237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c374564-e4c0-4ed6-851c-72421d44c5bf None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:01.071726 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c374564-e4c0-4ed6-851c-72421d44c5bf None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:01.071963 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c374564-e4c0-4ed6-851c-72421d44c5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:01.099383 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-7c374564-e4c0-4ed6-851c-72421d44c5bf None None] MFA Rules not processed for user `14f9c8a205da4710bfad135b6c6500f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:01.100674 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-7c374564-e4c0-4ed6-851c-72421d44c5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:01.167521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1411/2830] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:01.178569 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55152aef-56ba-424e-b20d-0e811878dd00 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:01.180347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-55152aef-56ba-424e-b20d-0e811878dd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:01.241697 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55152aef-56ba-424e-b20d-0e811878dd00 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:01.246151 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10f1e8-fd67-43bb-af5b-daf2e4076af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:01.246785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10f1e8-fd67-43bb-af5b-daf2e4076af3 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:01.247064 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10f1e8-fd67-43bb-af5b-daf2e4076af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:01.247339 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10f1e8-fd67-43bb-af5b-daf2e4076af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:01.257234 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10f1e8-fd67-43bb-af5b-daf2e4076af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:01.258745 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10f1e8-fd67-43bb-af5b-daf2e4076af3 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:01.268423 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1420/2831] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:01 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:01.416386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c374564-e4c0-4ed6-851c-72421d44c5bf None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:01.426870 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c374564-e4c0-4ed6-851c-72421d44c5bf None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:01.430341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03220dd9-cec3-4e9e-bb55-0a00cda3921a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:01.430944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03220dd9-cec3-4e9e-bb55-0a00cda3921a service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:01.431223 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03220dd9-cec3-4e9e-bb55-0a00cda3921a service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:01.431498 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03220dd9-cec3-4e9e-bb55-0a00cda3921a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:01.488370 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03220dd9-cec3-4e9e-bb55-0a00cda3921a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:01.489822 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03220dd9-cec3-4e9e-bb55-0a00cda3921a service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:01.498812 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1412/2832] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:01 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:06.716695 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10f1e8-fd67-43bb-af5b-daf2e4076af3 service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:06.777921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10f1e8-fd67-43bb-af5b-daf2e4076af3 service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:06.782449 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:06.783601 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:06.783880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:06.784148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] PATH_INFO: `/v3/users/95a73b7519ef4664bd94c2335117118a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:06.785285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a73b7519ef4664bd94c2335117118a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:06.787176 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:06.834911 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a73b7519ef4664bd94c2335117118a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:06.835494 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a73b7519ef4664bd94c2335117118a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:06.847851 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a73b7519ef4664bd94c2335117118a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:06.854707 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a73b7519ef4664bd94c2335117118a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:06.855337 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a73b7519ef4664bd94c2335117118a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:06.868255 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1421/2833] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:21:06 2022] DELETE /identity/v3/users/95a73b7519ef4664bd94c2335117118a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:06.872850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb7499-1274-4bd2-a813-9c28de000d80 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:06.873364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb7499-1274-4bd2-a813-9c28de000d80 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:06.873480 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb7499-1274-4bd2-a813-9c28de000d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:06.891807 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b8bb7499-1274-4bd2-a813-9c28de000d80 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:06.893048 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b8bb7499-1274-4bd2-a813-9c28de000d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:06.934410 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=100 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:06.952815 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1413/2834] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:06.962918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:06.964322 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:06.978775 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:07.025506 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab4a42-0b4e-4269-abf6-eb3984f7e461 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:07.029142 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d84e46-88c2-41fc-923b-5d8b0058cab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:07.029751 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d84e46-88c2-41fc-923b-5d8b0058cab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:07.030034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d84e46-88c2-41fc-923b-5d8b0058cab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:07.030312 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d84e46-88c2-41fc-923b-5d8b0058cab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:07.039917 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d84e46-88c2-41fc-923b-5d8b0058cab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:07.041391 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d84e46-88c2-41fc-923b-5d8b0058cab6 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:07.050888 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1422/2835] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:07.318251 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb7499-1274-4bd2-a813-9c28de000d80 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:07.319779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b8bb7499-1274-4bd2-a813-9c28de000d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:07.333123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb7499-1274-4bd2-a813-9c28de000d80 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:07.337841 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:07.338488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:07.338779 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:07.339057 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] PATH_INFO: `/v3/projects/c5dcdd12c72f45fbaf9b82a5c87ec778` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:07.340501 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5dcdd12c72f45fbaf9b82a5c87ec778)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:07.343226 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:07.393488 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5dcdd12c72f45fbaf9b82a5c87ec778', 'request_id': 'req-c1e693df-904c-4ee7-a0bc-1971c51a082a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.399400 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5dcdd12c72f45fbaf9b82a5c87ec778', 'request_id': 'req-c1e693df-904c-4ee7-a0bc-1971c51a082a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.406744 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5dcdd12c72f45fbaf9b82a5c87ec778', 'request_id': 'req-c1e693df-904c-4ee7-a0bc-1971c51a082a'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.416717 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] The token cache is being invalidate because project c5dcdd12c72f45fbaf9b82a5c87ec778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:21:07.417002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.417623 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.419158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1414/2836] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:21:07 2022] DELETE /identity/v3/projects/c5dcdd12c72f45fbaf9b82a5c87ec778 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:07.423224 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d84e46-88c2-41fc-923b-5d8b0058cab6 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:07.432820 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d84e46-88c2-41fc-923b-5d8b0058cab6 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:07.494447 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:07.495105 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:07.495383 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:07.495658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] PATH_INFO: `/v3/users/14f9c8a205da4710bfad135b6c6500f5` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:07.496796 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f9c8a205da4710bfad135b6c6500f5)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:07.498703 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:07.549175 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f9c8a205da4710bfad135b6c6500f5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.549825 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f9c8a205da4710bfad135b6c6500f5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.561599 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f9c8a205da4710bfad135b6c6500f5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.568862 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f9c8a205da4710bfad135b6c6500f5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.569493 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-c0bd7ec0-46bc-48b8-8331-eb705afbe8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f9c8a205da4710bfad135b6c6500f5'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.582960 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1423/2837] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:21:07 2022] DELETE /identity/v3/users/14f9c8a205da4710bfad135b6c6500f5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:07.851114 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:07.852703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:07.866991 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e693df-904c-4ee7-a0bc-1971c51a082a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:07.922989 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:07.924228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:07.924545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:07.924885 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] PATH_INFO: `/v3/projects/0a9155868fd14f8e886ced391ff3df88` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:07.926127 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9155868fd14f8e886ced391ff3df88)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:07.928029 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:07.974105 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9155868fd14f8e886ced391ff3df88', 'request_id': 'req-bb31aaaf-6795-415f-9979-a787abb665f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.980064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9155868fd14f8e886ced391ff3df88', 'request_id': 'req-bb31aaaf-6795-415f-9979-a787abb665f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.987470 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9155868fd14f8e886ced391ff3df88', 'request_id': 'req-bb31aaaf-6795-415f-9979-a787abb665f3'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:07.993608 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:07.999887 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] The token cache is being invalidate because project 0a9155868fd14f8e886ced391ff3df88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:21:08.000372 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:08.001318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb31aaaf-6795-415f-9979-a787abb665f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:08.003432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1415/2838] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:21:07 2022] DELETE /identity/v3/projects/0a9155868fd14f8e886ced391ff3df88 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:08.008399 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993483-f005-41a9-b6cf-7eb684f5ab96 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:08.008938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993483-f005-41a9-b6cf-7eb684f5ab96 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:08.009038 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993483-f005-41a9-b6cf-7eb684f5ab96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:08.027899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-22993483-f005-41a9-b6cf-7eb684f5ab96 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:08.029136 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-22993483-f005-41a9-b6cf-7eb684f5ab96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:08.057812 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:08.089335 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1424/2839] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:08.098796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca7aa5-34dc-411a-9256-b02fde41bad6 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:08.099110 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca7aa5-34dc-411a-9256-b02fde41bad6 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:08.099389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca7aa5-34dc-411a-9256-b02fde41bad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:08.118987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-feca7aa5-34dc-411a-9256-b02fde41bad6 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:08.120163 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-feca7aa5-34dc-411a-9256-b02fde41bad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:08.127854 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1416/2840] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:08.132013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993483-f005-41a9-b6cf-7eb684f5ab96 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:08.142001 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993483-f005-41a9-b6cf-7eb684f5ab96 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:08.146651 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc555f4b-484b-435e-8723-7e62b9be30e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:08.147256 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc555f4b-484b-435e-8723-7e62b9be30e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:08.147539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc555f4b-484b-435e-8723-7e62b9be30e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:08.147819 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc555f4b-484b-435e-8723-7e62b9be30e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:08.148477 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc555f4b-484b-435e-8723-7e62b9be30e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:21:08.148811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc555f4b-484b-435e-8723-7e62b9be30e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:08.150431 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc555f4b-484b-435e-8723-7e62b9be30e2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:08.162345 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1425/2841] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 17:21:08.166487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca7aa5-34dc-411a-9256-b02fde41bad6 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:08.176077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca7aa5-34dc-411a-9256-b02fde41bad6 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:08.181089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89b391-bd54-431f-a31c-e52c3f8d78fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:08.181638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89b391-bd54-431f-a31c-e52c3f8d78fb admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:08.181921 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89b391-bd54-431f-a31c-e52c3f8d78fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:08.182198 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89b391-bd54-431f-a31c-e52c3f8d78fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:08.182833 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89b391-bd54-431f-a31c-e52c3f8d78fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:08.184766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89b391-bd54-431f-a31c-e52c3f8d78fb admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:08.211079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1417/2842] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:21:08 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:08.215106 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc555f4b-484b-435e-8723-7e62b9be30e2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:08.225759 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc555f4b-484b-435e-8723-7e62b9be30e2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:08.280145 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7d9b-555b-4790-ab75-f26eab507f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:08.280777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7d9b-555b-4790-ab75-f26eab507f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:08.281059 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7d9b-555b-4790-ab75-f26eab507f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:08.281331 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7d9b-555b-4790-ab75-f26eab507f45 admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:08.281996 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df7d9b-555b-4790-ab75-f26eab507f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:08.284476 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df7d9b-555b-4790-ab75-f26eab507f45 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:08.304774 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1426/2843] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:21:08 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:08.308926 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89b391-bd54-431f-a31c-e52c3f8d78fb admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:08.319053 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89b391-bd54-431f-a31c-e52c3f8d78fb admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:08.323586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11079069-c050-41bd-af51-c0e45a6eed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:08.324179 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11079069-c050-41bd-af51-c0e45a6eed8a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:08.324466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11079069-c050-41bd-af51-c0e45a6eed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:08.324751 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11079069-c050-41bd-af51-c0e45a6eed8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:08.325387 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11079069-c050-41bd-af51-c0e45a6eed8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:08.327015 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11079069-c050-41bd-af51-c0e45a6eed8a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:08.337079 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1418/2844] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:08.340597 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7d9b-555b-4790-ab75-f26eab507f45 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:08.351347 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7d9b-555b-4790-ab75-f26eab507f45 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:08.355971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b4c3f-79c0-4dd9-a208-8eccb13ff554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:08.356586 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4c3f-79c0-4dd9-a208-8eccb13ff554 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:08.356867 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4c3f-79c0-4dd9-a208-8eccb13ff554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:08.357138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4c3f-79c0-4dd9-a208-8eccb13ff554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:08.357771 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b4c3f-79c0-4dd9-a208-8eccb13ff554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:08.359329 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b4c3f-79c0-4dd9-a208-8eccb13ff554 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:08.370288 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1427/2845] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:08.374173 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11079069-c050-41bd-af51-c0e45a6eed8a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:08.383769 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11079069-c050-41bd-af51-c0e45a6eed8a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:08.388272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de68e9-5910-49ff-b595-73650ef38a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:08.388950 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de68e9-5910-49ff-b595-73650ef38a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:08.389231 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de68e9-5910-49ff-b595-73650ef38a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:08.389503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de68e9-5910-49ff-b595-73650ef38a46 admin admin] PATH_INFO: `/v3/projects/61d17ef42e0a498ba36077b2a516b3cc/users/b4d697ebd5a14458a8aa1ac42ea71d88/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:08.404617 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de68e9-5910-49ff-b595-73650ef38a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d17ef42e0a498ba36077b2a516b3cc, user_id=b4d697ebd5a14458a8aa1ac42ea71d88, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:08.407202 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de68e9-5910-49ff-b595-73650ef38a46 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:08.419875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1419/2846] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:08 2022] PUT /identity/v3/projects/61d17ef42e0a498ba36077b2a516b3cc/users/b4d697ebd5a14458a8aa1ac42ea71d88/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:21:08.430701 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c57e-25b7-46bc-84db-4de5fe5de3d5 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:08.430988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c57e-25b7-46bc-84db-4de5fe5de3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:08.431320 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938c57e-25b7-46bc-84db-4de5fe5de3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:08.457912 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-9938c57e-25b7-46bc-84db-4de5fe5de3d5 None None] MFA Rules not processed for user `b4d697ebd5a14458a8aa1ac42ea71d88`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:08.459127 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-9938c57e-25b7-46bc-84db-4de5fe5de3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:08.521553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1428/2847] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:08.532170 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de68e9-5910-49ff-b595-73650ef38a46 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:08.534475 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-16de68e9-5910-49ff-b595-73650ef38a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:08.589535 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de68e9-5910-49ff-b595-73650ef38a46 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:08.593381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce4919-5eb6-405e-b650-14abb183c7ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:08.593981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce4919-5eb6-405e-b650-14abb183c7ca service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:08.594258 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce4919-5eb6-405e-b650-14abb183c7ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:08.594557 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce4919-5eb6-405e-b650-14abb183c7ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:08.603282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce4919-5eb6-405e-b650-14abb183c7ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:08.604716 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce4919-5eb6-405e-b650-14abb183c7ca service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:08.613317 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1420/2848] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:13.900235 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c57e-25b7-46bc-84db-4de5fe5de3d5 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:13.931928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:13.964079 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938c57e-25b7-46bc-84db-4de5fe5de3d5 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:13.968907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:13.969533 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:13.969817 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:13.970091 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] PATH_INFO: `/v3/users/b4d697ebd5a14458a8aa1ac42ea71d88` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:13.971835 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d697ebd5a14458a8aa1ac42ea71d88)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:13.973770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:14.018368 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d697ebd5a14458a8aa1ac42ea71d88'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:14.019027 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d697ebd5a14458a8aa1ac42ea71d88'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:14.030995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d697ebd5a14458a8aa1ac42ea71d88'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:14.038363 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d697ebd5a14458a8aa1ac42ea71d88'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:14.039002 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d697ebd5a14458a8aa1ac42ea71d88'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:14.051132 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1429/2849] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:21:13 2022] DELETE /identity/v3/users/b4d697ebd5a14458a8aa1ac42ea71d88 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:14.055567 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6fb7f-411c-4dd2-8d2c-c06162e8c6fb None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.056049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6fb7f-411c-4dd2-8d2c-c06162e8c6fb None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.056148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6fb7f-411c-4dd2-8d2c-c06162e8c6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.074858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-dfa6fb7f-411c-4dd2-8d2c-c06162e8c6fb None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:14.076049 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dfa6fb7f-411c-4dd2-8d2c-c06162e8c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:14.133074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1421/2850] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:14.143553 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:14.144981 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:14.200683 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93a639-3f8c-4d41-9bed-b3fa47ad97c9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:14.204328 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138cc1c-eae1-4c6d-8a30-2b70be8ef58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:14.205582 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cc1c-eae1-4c6d-8a30-2b70be8ef58e service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.205864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cc1c-eae1-4c6d-8a30-2b70be8ef58e service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.206137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cc1c-eae1-4c6d-8a30-2b70be8ef58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.215051 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138cc1c-eae1-4c6d-8a30-2b70be8ef58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:14.216784 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138cc1c-eae1-4c6d-8a30-2b70be8ef58e service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:14.226070 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1430/2851] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:14.480629 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6fb7f-411c-4dd2-8d2c-c06162e8c6fb None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:14.482162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-dfa6fb7f-411c-4dd2-8d2c-c06162e8c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:14.494864 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6fb7f-411c-4dd2-8d2c-c06162e8c6fb None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:14.499545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:14.500280 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.500599 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.500879 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] PATH_INFO: `/v3/projects/61d17ef42e0a498ba36077b2a516b3cc` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.502719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d17ef42e0a498ba36077b2a516b3cc)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:14.504654 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:14.539693 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:14.553860 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d17ef42e0a498ba36077b2a516b3cc', 'request_id': 'req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:14.560115 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d17ef42e0a498ba36077b2a516b3cc', 'request_id': 'req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:14.568229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d17ef42e0a498ba36077b2a516b3cc', 'request_id': 'req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:14.578281 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] The token cache is being invalidate because project 61d17ef42e0a498ba36077b2a516b3cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:21:14.578569 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:14.579191 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-0d1feaae-59e0-4f85-b06d-7ff5814fecb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:14.580749 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1422/2852] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:21:14 2022] DELETE /identity/v3/projects/61d17ef42e0a498ba36077b2a516b3cc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:14.585659 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a38144-ca46-4db3-bfbf-aa9516a05564 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.585946 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a38144-ca46-4db3-bfbf-aa9516a05564 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.586223 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a38144-ca46-4db3-bfbf-aa9516a05564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.605457 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-06a38144-ca46-4db3-bfbf-aa9516a05564 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:14.606658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-06a38144-ca46-4db3-bfbf-aa9516a05564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:14.651037 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:14.666227 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1431/2853] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:14.674455 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249f524-ace5-4dce-a3a0-6a29dcfc100a None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.674738 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249f524-ace5-4dce-a3a0-6a29dcfc100a None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.675008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249f524-ace5-4dce-a3a0-6a29dcfc100a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.694558 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-f249f524-ace5-4dce-a3a0-6a29dcfc100a None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:14.695742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-f249f524-ace5-4dce-a3a0-6a29dcfc100a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:14.703503 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1423/2854] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:14.707487 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a38144-ca46-4db3-bfbf-aa9516a05564 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:14.717221 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a38144-ca46-4db3-bfbf-aa9516a05564 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:14.721734 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0f5f6-76f8-4606-a179-e4f7310c4d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:14.722324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0f5f6-76f8-4606-a179-e4f7310c4d7f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.722604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0f5f6-76f8-4606-a179-e4f7310c4d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.722878 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0f5f6-76f8-4606-a179-e4f7310c4d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.723519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0f5f6-76f8-4606-a179-e4f7310c4d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81514) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:21:14.723821 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0f5f6-76f8-4606-a179-e4f7310c4d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:14.725437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0f5f6-76f8-4606-a179-e4f7310c4d7f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:14.737394 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1432/2855] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 17:21:14.741866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249f524-ace5-4dce-a3a0-6a29dcfc100a None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:14.750737 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249f524-ace5-4dce-a3a0-6a29dcfc100a None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:14.755961 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674feb5f-6dae-4ca9-ab15-4d8c7da1a8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:14.756589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674feb5f-6dae-4ca9-ab15-4d8c7da1a8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.756866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674feb5f-6dae-4ca9-ab15-4d8c7da1a8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.757137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674feb5f-6dae-4ca9-ab15-4d8c7da1a8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.757764 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674feb5f-6dae-4ca9-ab15-4d8c7da1a8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:14.759631 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674feb5f-6dae-4ca9-ab15-4d8c7da1a8ef admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:14.786127 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1424/2856] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:21:14 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:21:14.790167 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0f5f6-76f8-4606-a179-e4f7310c4d7f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:14.800612 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0f5f6-76f8-4606-a179-e4f7310c4d7f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:14.856138 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa899c-0d27-489d-a9bb-83062bb447bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:14.856760 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa899c-0d27-489d-a9bb-83062bb447bd admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.857043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa899c-0d27-489d-a9bb-83062bb447bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.857318 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa899c-0d27-489d-a9bb-83062bb447bd admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.857927 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa899c-0d27-489d-a9bb-83062bb447bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:14.859816 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa899c-0d27-489d-a9bb-83062bb447bd admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:14.880237 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1433/2857] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:21:14 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:14.884325 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674feb5f-6dae-4ca9-ab15-4d8c7da1a8ef admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:14.894270 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674feb5f-6dae-4ca9-ab15-4d8c7da1a8ef admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:14.899008 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871485b-9c59-49a5-8274-4c6c3d8ff353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:14.899615 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871485b-9c59-49a5-8274-4c6c3d8ff353 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.899899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871485b-9c59-49a5-8274-4c6c3d8ff353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.900176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871485b-9c59-49a5-8274-4c6c3d8ff353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.900875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871485b-9c59-49a5-8274-4c6c3d8ff353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:14.902487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871485b-9c59-49a5-8274-4c6c3d8ff353 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:14.912964 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1425/2858] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 17:21:14.916613 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa899c-0d27-489d-a9bb-83062bb447bd admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:14.926903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa899c-0d27-489d-a9bb-83062bb447bd admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:14.931460 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11d0f-9a6c-4ec6-81f8-1726510b16e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:14.932046 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11d0f-9a6c-4ec6-81f8-1726510b16e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.932324 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11d0f-9a6c-4ec6-81f8-1726510b16e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.932629 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11d0f-9a6c-4ec6-81f8-1726510b16e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.933264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf11d0f-9a6c-4ec6-81f8-1726510b16e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:14.934837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf11d0f-9a6c-4ec6-81f8-1726510b16e7 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:14.945083 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1434/2859] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:14.949149 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871485b-9c59-49a5-8274-4c6c3d8ff353 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:14.959547 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871485b-9c59-49a5-8274-4c6c3d8ff353 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:14.964104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a39c1-c2ef-4e29-a8f0-57adb4b94a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:14.964789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a39c1-c2ef-4e29-a8f0-57adb4b94a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:14.965075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a39c1-c2ef-4e29-a8f0-57adb4b94a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:14.965359 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a39c1-c2ef-4e29-a8f0-57adb4b94a78 admin admin] PATH_INFO: `/v3/projects/c43550a7eacc4571b3e52c4997241a15/users/031d2c5c6c91418f90764fd61d95bfc7/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:14.980229 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a39c1-c2ef-4e29-a8f0-57adb4b94a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43550a7eacc4571b3e52c4997241a15, user_id=031d2c5c6c91418f90764fd61d95bfc7, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:14.982972 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a39c1-c2ef-4e29-a8f0-57adb4b94a78 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:14.996133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1426/2860] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:14 2022] PUT /identity/v3/projects/c43550a7eacc4571b3e52c4997241a15/users/031d2c5c6c91418f90764fd61d95bfc7/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:15.059826 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f92570-af33-4f8d-8f77-404776144929 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.060117 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f92570-af33-4f8d-8f77-404776144929 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.060402 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f92570-af33-4f8d-8f77-404776144929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.087076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-30f92570-af33-4f8d-8f77-404776144929 None None] MFA Rules not processed for user `031d2c5c6c91418f90764fd61d95bfc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:15.088280 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-30f92570-af33-4f8d-8f77-404776144929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:15.149985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1435/2861] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:15.154461 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a39c1-c2ef-4e29-a8f0-57adb4b94a78 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.219851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a39c1-c2ef-4e29-a8f0-57adb4b94a78 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.224982 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27500dae-61c8-40bc-a09b-f04f68294e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.225588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500dae-61c8-40bc-a09b-f04f68294e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.225873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500dae-61c8-40bc-a09b-f04f68294e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.226152 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27500dae-61c8-40bc-a09b-f04f68294e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.226784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27500dae-61c8-40bc-a09b-f04f68294e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.228703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27500dae-61c8-40bc-a09b-f04f68294e5d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.254070 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1427/2862] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:21:15 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:21:15.258141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f92570-af33-4f8d-8f77-404776144929 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.269215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f92570-af33-4f8d-8f77-404776144929 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.311485 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:15.324988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a63ba5-2cea-4440-bb43-8bcf98270b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.325594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a63ba5-2cea-4440-bb43-8bcf98270b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.325880 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a63ba5-2cea-4440-bb43-8bcf98270b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.326156 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a63ba5-2cea-4440-bb43-8bcf98270b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.326786 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a63ba5-2cea-4440-bb43-8bcf98270b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.328715 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a63ba5-2cea-4440-bb43-8bcf98270b9e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.350362 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1436/2863] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:21:15 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:15.354345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27500dae-61c8-40bc-a09b-f04f68294e5d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.364489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27500dae-61c8-40bc-a09b-f04f68294e5d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.369005 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aafd2f-1188-473d-aeea-26b88a408225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.369598 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aafd2f-1188-473d-aeea-26b88a408225 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.369876 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aafd2f-1188-473d-aeea-26b88a408225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.370150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aafd2f-1188-473d-aeea-26b88a408225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.370784 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aafd2f-1188-473d-aeea-26b88a408225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.372483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aafd2f-1188-473d-aeea-26b88a408225 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.382851 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1428/2864] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:15.386567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a63ba5-2cea-4440-bb43-8bcf98270b9e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.397063 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a63ba5-2cea-4440-bb43-8bcf98270b9e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.401611 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b714-7da3-4edf-9063-805bce6511c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.402200 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b714-7da3-4edf-9063-805bce6511c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.402483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b714-7da3-4edf-9063-805bce6511c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.402762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b714-7da3-4edf-9063-805bce6511c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.403405 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607b714-7da3-4edf-9063-805bce6511c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.405020 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607b714-7da3-4edf-9063-805bce6511c4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.415148 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1437/2865] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:15.418979 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aafd2f-1188-473d-aeea-26b88a408225 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.428850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aafd2f-1188-473d-aeea-26b88a408225 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.433397 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dffb8d-f304-4ffd-b80d-5801acc88df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.434032 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dffb8d-f304-4ffd-b80d-5801acc88df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.434312 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dffb8d-f304-4ffd-b80d-5801acc88df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.434588 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dffb8d-f304-4ffd-b80d-5801acc88df1 admin admin] PATH_INFO: `/v3/projects/71fad1459baa4b3887f7d31cf0678e2f/users/bcacbde29f38414e88a5d6acd0359de5/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.449026 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dffb8d-f304-4ffd-b80d-5801acc88df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fad1459baa4b3887f7d31cf0678e2f, user_id=bcacbde29f38414e88a5d6acd0359de5, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.451641 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dffb8d-f304-4ffd-b80d-5801acc88df1 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.464466 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1429/2866] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:15 2022] PUT /identity/v3/projects/71fad1459baa4b3887f7d31cf0678e2f/users/bcacbde29f38414e88a5d6acd0359de5/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:21:15.475281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03a3a8-743e-48ee-99ac-04fba24ff3bb None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.475511 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03a3a8-743e-48ee-99ac-04fba24ff3bb None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.475789 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03a3a8-743e-48ee-99ac-04fba24ff3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.502662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-3a03a3a8-743e-48ee-99ac-04fba24ff3bb None None] MFA Rules not processed for user `bcacbde29f38414e88a5d6acd0359de5`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:15.503859 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-3a03a3a8-743e-48ee-99ac-04fba24ff3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:15.567314 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1438/2867] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:21:15.571875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dffb8d-f304-4ffd-b80d-5801acc88df1 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.581620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:15.635276 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dffb8d-f304-4ffd-b80d-5801acc88df1 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.639958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd3cbf-72ad-4483-83bc-d7de8031bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.640589 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd3cbf-72ad-4483-83bc-d7de8031bb08 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.640872 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd3cbf-72ad-4483-83bc-d7de8031bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.641148 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd3cbf-72ad-4483-83bc-d7de8031bb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.641763 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd3cbf-72ad-4483-83bc-d7de8031bb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.644288 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd3cbf-72ad-4483-83bc-d7de8031bb08 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.669669 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1430/2868] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:21:15 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:15.673892 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03a3a8-743e-48ee-99ac-04fba24ff3bb None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.684441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03a3a8-743e-48ee-99ac-04fba24ff3bb None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.742078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d870efa-718b-4155-94f4-b04d5e0df68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.742693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d870efa-718b-4155-94f4-b04d5e0df68c admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.742976 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d870efa-718b-4155-94f4-b04d5e0df68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.743254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d870efa-718b-4155-94f4-b04d5e0df68c admin admin] PATH_INFO: `/v3/users` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.743874 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d870efa-718b-4155-94f4-b04d5e0df68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.745807 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d870efa-718b-4155-94f4-b04d5e0df68c admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.766869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1439/2869] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:21:15 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:15.771568 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd3cbf-72ad-4483-83bc-d7de8031bb08 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.781974 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd3cbf-72ad-4483-83bc-d7de8031bb08 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.786752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d65b3-d867-4aaa-b611-a574f0b342c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.787382 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d65b3-d867-4aaa-b611-a574f0b342c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.787691 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d65b3-d867-4aaa-b611-a574f0b342c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.787992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d65b3-d867-4aaa-b611-a574f0b342c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.788609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d65b3-d867-4aaa-b611-a574f0b342c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.790205 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d65b3-d867-4aaa-b611-a574f0b342c4 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.801753 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1431/2870] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:15.805772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d870efa-718b-4155-94f4-b04d5e0df68c admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.816404 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d870efa-718b-4155-94f4-b04d5e0df68c admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.820965 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e6b0-1f86-490f-9566-0970d21d81d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.821606 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e6b0-1f86-490f-9566-0970d21d81d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.821883 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e6b0-1f86-490f-9566-0970d21d81d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.822155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e6b0-1f86-490f-9566-0970d21d81d9 admin admin] PATH_INFO: `/v3/projects/f09a4087d7e24a02b29c8ed8daae7705/users/51d563bc684f4f92ba80dfac3b5254bc/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.837019 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0e6b0-1f86-490f-9566-0970d21d81d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09a4087d7e24a02b29c8ed8daae7705, user_id=51d563bc684f4f92ba80dfac3b5254bc, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.839633 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0e6b0-1f86-490f-9566-0970d21d81d9 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.853500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1440/2871] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:15 2022] PUT /identity/v3/projects/f09a4087d7e24a02b29c8ed8daae7705/users/51d563bc684f4f92ba80dfac3b5254bc/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:21:15.857485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d65b3-d867-4aaa-b611-a574f0b342c4 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.867313 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d65b3-d867-4aaa-b611-a574f0b342c4 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.922075 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe48ff-04d8-437c-be95-a045008259c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.922676 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe48ff-04d8-437c-be95-a045008259c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.922958 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe48ff-04d8-437c-be95-a045008259c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.923235 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe48ff-04d8-437c-be95-a045008259c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.924381 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe48ff-04d8-437c-be95-a045008259c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.926188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe48ff-04d8-437c-be95-a045008259c2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.935775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1432/2872] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:15.940437 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e6b0-1f86-490f-9566-0970d21d81d9 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:15.950541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e6b0-1f86-490f-9566-0970d21d81d9 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:15.955057 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217324b-cfac-4f00-b9a1-2ec6b152cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:15.955694 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217324b-cfac-4f00-b9a1-2ec6b152cfca admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.955972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217324b-cfac-4f00-b9a1-2ec6b152cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.956247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217324b-cfac-4f00-b9a1-2ec6b152cfca admin admin] PATH_INFO: `/v3/projects/f09a4087d7e24a02b29c8ed8daae7705/users/51d563bc684f4f92ba80dfac3b5254bc/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:15.958307 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217324b-cfac-4f00-b9a1-2ec6b152cfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09a4087d7e24a02b29c8ed8daae7705, user_id=51d563bc684f4f92ba80dfac3b5254bc, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:15.960938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217324b-cfac-4f00-b9a1-2ec6b152cfca admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:15.971010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1441/2873] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:15 2022] PUT /identity/v3/projects/f09a4087d7e24a02b29c8ed8daae7705/users/51d563bc684f4f92ba80dfac3b5254bc/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 17:21:15.981861 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1cd7f-d8ce-452c-8ef4-de1d3e96da95 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:15.982153 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1cd7f-d8ce-452c-8ef4-de1d3e96da95 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:15.982430 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1cd7f-d8ce-452c-8ef4-de1d3e96da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:16.010637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-ecf1cd7f-d8ce-452c-8ef4-de1d3e96da95 None None] MFA Rules not processed for user `51d563bc684f4f92ba80dfac3b5254bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:16.011759 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ecf1cd7f-d8ce-452c-8ef4-de1d3e96da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:16.077796 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1433/2874] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:16.088906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217324b-cfac-4f00-b9a1-2ec6b152cfca admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:16.090624 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d217324b-cfac-4f00-b9a1-2ec6b152cfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:16.100823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:16.148642 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217324b-cfac-4f00-b9a1-2ec6b152cfca admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:16.152282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29e526-e448-4e14-b2c8-16a9297f386f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:16.152913 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29e526-e448-4e14-b2c8-16a9297f386f service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:16.153193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29e526-e448-4e14-b2c8-16a9297f386f service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:16.153467 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29e526-e448-4e14-b2c8-16a9297f386f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:16.208445 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29e526-e448-4e14-b2c8-16a9297f386f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:16.209938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29e526-e448-4e14-b2c8-16a9297f386f service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:16.218984 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1442/2875] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:17.714664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1cd7f-d8ce-452c-8ef4-de1d3e96da95 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:17.716408 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ecf1cd7f-d8ce-452c-8ef4-de1d3e96da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:17.723806 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:17.730682 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1cd7f-d8ce-452c-8ef4-de1d3e96da95 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:17.734260 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc92a9-3035-491d-9a73-b3089046d169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:17.734883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc92a9-3035-491d-9a73-b3089046d169 service cinder] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:17.735167 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc92a9-3035-491d-9a73-b3089046d169 service cinder] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:17.735440 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc92a9-3035-491d-9a73-b3089046d169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:17.791847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc92a9-3035-491d-9a73-b3089046d169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:17.793242 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc92a9-3035-491d-9a73-b3089046d169 service cinder] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:17.802150 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1434/2876] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:18.297101 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29e526-e448-4e14-b2c8-16a9297f386f service cinder] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:18.306464 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29e526-e448-4e14-b2c8-16a9297f386f service cinder] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:18.310316 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d07d95-c5a0-49f4-ae24-2a621ae5ba84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:18.310906 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d07d95-c5a0-49f4-ae24-2a621ae5ba84 service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:18.311212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d07d95-c5a0-49f4-ae24-2a621ae5ba84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:18.311567 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d07d95-c5a0-49f4-ae24-2a621ae5ba84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:18.321559 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d07d95-c5a0-49f4-ae24-2a621ae5ba84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:18.322998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d07d95-c5a0-49f4-ae24-2a621ae5ba84 service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:18.332341 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1443/2877] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:22.175576 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc92a9-3035-491d-9a73-b3089046d169 service cinder] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:22.236775 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc92a9-3035-491d-9a73-b3089046d169 service cinder] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:22.241236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:22.241863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:22.242146 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:22.242419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] PATH_INFO: `/v3/users/031d2c5c6c91418f90764fd61d95bfc7` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:22.243527 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=031d2c5c6c91418f90764fd61d95bfc7)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:22.245480 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:22.290345 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031d2c5c6c91418f90764fd61d95bfc7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.297063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031d2c5c6c91418f90764fd61d95bfc7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.297681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031d2c5c6c91418f90764fd61d95bfc7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.298282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031d2c5c6c91418f90764fd61d95bfc7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.305692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031d2c5c6c91418f90764fd61d95bfc7'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.322506 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1435/2878] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:21:22 2022] DELETE /identity/v3/users/031d2c5c6c91418f90764fd61d95bfc7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:22.326923 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b82bc2-9f49-4062-af41-ac6acd6d4747 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:22.327448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b82bc2-9f49-4062-af41-ac6acd6d4747 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:22.327448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b82bc2-9f49-4062-af41-ac6acd6d4747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:22.346472 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d9b82bc2-9f49-4062-af41-ac6acd6d4747 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:22.347677 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d9b82bc2-9f49-4062-af41-ac6acd6d4747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:22.404514 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1444/2879] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:22.414650 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:22.416044 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:22.437996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:22.475513 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1338ad-a476-4297-9579-8720463fe5bf admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:22.479135 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e444d-5803-4035-8c18-419f74c5fb7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:22.479739 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e444d-5803-4035-8c18-419f74c5fb7b service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:22.480021 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e444d-5803-4035-8c18-419f74c5fb7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:22.480296 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e444d-5803-4035-8c18-419f74c5fb7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:22.489832 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e444d-5803-4035-8c18-419f74c5fb7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:22.491264 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e444d-5803-4035-8c18-419f74c5fb7b service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:22.500644 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1436/2880] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:22.760881 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b82bc2-9f49-4062-af41-ac6acd6d4747 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:22.762371 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d9b82bc2-9f49-4062-af41-ac6acd6d4747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:22.776183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b82bc2-9f49-4062-af41-ac6acd6d4747 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:22.781003 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:22.782074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:22.782074 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:22.782285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] PATH_INFO: `/v3/projects/c43550a7eacc4571b3e52c4997241a15` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:22.783988 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43550a7eacc4571b3e52c4997241a15)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:22.785924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:22.828231 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:22.832401 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43550a7eacc4571b3e52c4997241a15', 'request_id': 'req-1deb45fb-669f-4159-bebc-b77579dc968e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.839214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43550a7eacc4571b3e52c4997241a15', 'request_id': 'req-1deb45fb-669f-4159-bebc-b77579dc968e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.845490 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43550a7eacc4571b3e52c4997241a15', 'request_id': 'req-1deb45fb-669f-4159-bebc-b77579dc968e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.856679 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] The token cache is being invalidate because project c43550a7eacc4571b3e52c4997241a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:21:22.856966 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.857592 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.859088 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1445/2881] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:21:22 2022] DELETE /identity/v3/projects/c43550a7eacc4571b3e52c4997241a15 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:22.863071 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e444d-5803-4035-8c18-419f74c5fb7b service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:22.872587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e444d-5803-4035-8c18-419f74c5fb7b service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:22.927747 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:22.928376 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:22.928689 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:22.928967 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] PATH_INFO: `/v3/users/bcacbde29f38414e88a5d6acd0359de5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:22.930074 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcacbde29f38414e88a5d6acd0359de5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:22.932030 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:22.975752 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcacbde29f38414e88a5d6acd0359de5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.982664 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcacbde29f38414e88a5d6acd0359de5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.983318 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcacbde29f38414e88a5d6acd0359de5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.983917 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcacbde29f38414e88a5d6acd0359de5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:22.990878 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcacbde29f38414e88a5d6acd0359de5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.007483 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1437/2882] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:21:22 2022] DELETE /identity/v3/users/bcacbde29f38414e88a5d6acd0359de5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:23.278193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:23.279781 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:23.292859 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb45fb-669f-4159-bebc-b77579dc968e admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:23.349742 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:23.350415 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:23.350646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:23.350922 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] PATH_INFO: `/v3/projects/71fad1459baa4b3887f7d31cf0678e2f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:23.352032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fad1459baa4b3887f7d31cf0678e2f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:23.353959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:23.398208 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fad1459baa4b3887f7d31cf0678e2f', 'request_id': 'req-1954b2e3-a358-4c85-b053-df224e0d49ac'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.404870 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fad1459baa4b3887f7d31cf0678e2f', 'request_id': 'req-1954b2e3-a358-4c85-b053-df224e0d49ac'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.410811 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fad1459baa4b3887f7d31cf0678e2f', 'request_id': 'req-1954b2e3-a358-4c85-b053-df224e0d49ac'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.421222 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] The token cache is being invalidate because project 71fad1459baa4b3887f7d31cf0678e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:21:23.421516 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.422262 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.424248 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1446/2883] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:21:23 2022] DELETE /identity/v3/projects/71fad1459baa4b3887f7d31cf0678e2f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:23.428413 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:23.429866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:23.443174 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763851a7-1a8c-4e25-970d-7f44931ea1ff admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:23.482094 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:23.499695 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:23.500324 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:23.500637 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:23.500918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] PATH_INFO: `/v3/users/51d563bc684f4f92ba80dfac3b5254bc` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:23.502655 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d563bc684f4f92ba80dfac3b5254bc)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:23.504595 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:23.549487 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d563bc684f4f92ba80dfac3b5254bc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.556603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d563bc684f4f92ba80dfac3b5254bc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.557215 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d563bc684f4f92ba80dfac3b5254bc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.557819 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d563bc684f4f92ba80dfac3b5254bc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.565532 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-d3c562d5-2a36-4815-86a6-31019eb1f041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d563bc684f4f92ba80dfac3b5254bc'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.582659 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1438/2884] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:21:23 2022] DELETE /identity/v3/users/51d563bc684f4f92ba80dfac3b5254bc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:23.849418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:23.853254 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:23.867571 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954b2e3-a358-4c85-b053-df224e0d49ac admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:23.935281 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:23.935953 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:23.936240 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:23.936548 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] PATH_INFO: `/v3/projects/f09a4087d7e24a02b29c8ed8daae7705` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:23.937685 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09a4087d7e24a02b29c8ed8daae7705)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:23.939761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:23.942199 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:23.988940 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09a4087d7e24a02b29c8ed8daae7705', 'request_id': 'req-2293266e-7c06-4548-97f2-2be45bddd32e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:23.997034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09a4087d7e24a02b29c8ed8daae7705', 'request_id': 'req-2293266e-7c06-4548-97f2-2be45bddd32e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:24.004541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09a4087d7e24a02b29c8ed8daae7705', 'request_id': 'req-2293266e-7c06-4548-97f2-2be45bddd32e'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:24.015628 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] The token cache is being invalidate because project f09a4087d7e24a02b29c8ed8daae7705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:21:24.015921 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:24.016603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-2293266e-7c06-4548-97f2-2be45bddd32e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:24.018139 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1447/2885] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:21:23 2022] DELETE /identity/v3/projects/f09a4087d7e24a02b29c8ed8daae7705 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:24.023398 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d70a-11eb-404b-974b-de235a2533fe None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:24.023905 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d70a-11eb-404b-974b-de235a2533fe None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:24.024253 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d70a-11eb-404b-974b-de235a2533fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:24.049356 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-5ba5d70a-11eb-404b-974b-de235a2533fe None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:24.051076 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5ba5d70a-11eb-404b-974b-de235a2533fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:24.112254 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1439/2886] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:24.119905 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28376b2-824f-4b92-896c-f1bdc3920e47 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:24.120195 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28376b2-824f-4b92-896c-f1bdc3920e47 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:24.120492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28376b2-824f-4b92-896c-f1bdc3920e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:24.140900 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-b28376b2-824f-4b92-896c-f1bdc3920e47 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:24.142123 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b28376b2-824f-4b92-896c-f1bdc3920e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:24.150279 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1448/2887] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:24.154386 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d70a-11eb-404b-974b-de235a2533fe None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:24.164613 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d70a-11eb-404b-974b-de235a2533fe None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:24.169132 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70caaa-00bf-4c9b-a5cf-d539cde16e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:24.169725 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70caaa-00bf-4c9b-a5cf-d539cde16e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:24.170003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70caaa-00bf-4c9b-a5cf-d539cde16e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:24.170271 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70caaa-00bf-4c9b-a5cf-d539cde16e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:24.170902 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70caaa-00bf-4c9b-a5cf-d539cde16e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:21:24.171199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70caaa-00bf-4c9b-a5cf-d539cde16e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:24.172817 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70caaa-00bf-4c9b-a5cf-d539cde16e6a admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:24.186838 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1440/2888] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:21:24.191110 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28376b2-824f-4b92-896c-f1bdc3920e47 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:24.200162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28376b2-824f-4b92-896c-f1bdc3920e47 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:24.205381 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb64e3-1fbd-4760-b92c-ad9e3b14c94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:24.205971 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb64e3-1fbd-4760-b92c-ad9e3b14c94b admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:24.206246 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb64e3-1fbd-4760-b92c-ad9e3b14c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:24.206512 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb64e3-1fbd-4760-b92c-ad9e3b14c94b admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:24.207147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb64e3-1fbd-4760-b92c-ad9e3b14c94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:24.209035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb64e3-1fbd-4760-b92c-ad9e3b14c94b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:24.235032 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1449/2889] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:21:24 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:24.239093 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70caaa-00bf-4c9b-a5cf-d539cde16e6a admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:24.248990 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70caaa-00bf-4c9b-a5cf-d539cde16e6a admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:24.292330 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:24.304828 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb67c16-34c1-4ca1-bc73-6b26bedd9ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:24.305432 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb67c16-34c1-4ca1-bc73-6b26bedd9ffd admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:24.305712 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb67c16-34c1-4ca1-bc73-6b26bedd9ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:24.305987 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb67c16-34c1-4ca1-bc73-6b26bedd9ffd admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:24.306614 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb67c16-34c1-4ca1-bc73-6b26bedd9ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:24.308547 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb67c16-34c1-4ca1-bc73-6b26bedd9ffd admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:24.328128 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1441/2890] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:21:24 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:24.332777 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb64e3-1fbd-4760-b92c-ad9e3b14c94b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:24.343396 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb64e3-1fbd-4760-b92c-ad9e3b14c94b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:24.348558 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253daee1-fbc8-43a6-b6fd-ecadf71fea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:24.349153 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253daee1-fbc8-43a6-b6fd-ecadf71fea4f admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:24.349433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253daee1-fbc8-43a6-b6fd-ecadf71fea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:24.349705 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253daee1-fbc8-43a6-b6fd-ecadf71fea4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:24.350343 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253daee1-fbc8-43a6-b6fd-ecadf71fea4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:24.351924 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253daee1-fbc8-43a6-b6fd-ecadf71fea4f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:24.362247 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1450/2891] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:24.366252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb67c16-34c1-4ca1-bc73-6b26bedd9ffd admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:24.376002 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb67c16-34c1-4ca1-bc73-6b26bedd9ffd admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:24.380609 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e569d-6a18-4672-946b-33036e3db5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:24.381200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e569d-6a18-4672-946b-33036e3db5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:24.381480 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e569d-6a18-4672-946b-33036e3db5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:24.381755 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e569d-6a18-4672-946b-33036e3db5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:24.382389 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e569d-6a18-4672-946b-33036e3db5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:24.383976 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e569d-6a18-4672-946b-33036e3db5c2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:24.394996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1442/2892] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:24.398956 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253daee1-fbc8-43a6-b6fd-ecadf71fea4f admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:24.409350 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253daee1-fbc8-43a6-b6fd-ecadf71fea4f admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:24.413845 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507160a-334f-4b31-846a-172ceb16f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:24.414479 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507160a-334f-4b31-846a-172ceb16f6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:24.414758 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507160a-334f-4b31-846a-172ceb16f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:24.415034 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507160a-334f-4b31-846a-172ceb16f6e2 admin admin] PATH_INFO: `/v3/projects/97f491465ff34361b7bcaeabf12e29b9/users/e5a11b1415eb4af6b7a2ac5cf1f882f5/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:24.428908 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507160a-334f-4b31-846a-172ceb16f6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f491465ff34361b7bcaeabf12e29b9, user_id=e5a11b1415eb4af6b7a2ac5cf1f882f5, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:24.431504 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507160a-334f-4b31-846a-172ceb16f6e2 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:24.443603 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1451/2893] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:24 2022] PUT /identity/v3/projects/97f491465ff34361b7bcaeabf12e29b9/users/e5a11b1415eb4af6b7a2ac5cf1f882f5/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:24.453720 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861596-2d50-427f-a6c5-7ffd11de6601 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:24.454249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861596-2d50-427f-a6c5-7ffd11de6601 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:24.454249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861596-2d50-427f-a6c5-7ffd11de6601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:24.482213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-31861596-2d50-427f-a6c5-7ffd11de6601 None None] MFA Rules not processed for user `e5a11b1415eb4af6b7a2ac5cf1f882f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:24.483409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-31861596-2d50-427f-a6c5-7ffd11de6601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:24.544940 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1443/2894] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:24.556024 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507160a-334f-4b31-846a-172ceb16f6e2 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:24.557761 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d507160a-334f-4b31-846a-172ceb16f6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:24.617348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507160a-334f-4b31-846a-172ceb16f6e2 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:24.620859 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83115c11-6ada-479a-8a74-d7a86d81e1aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2aa331983fbc4b18b7880084adcba3c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:24.621459 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83115c11-6ada-479a-8a74-d7a86d81e1aa service cinder] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:24.621738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83115c11-6ada-479a-8a74-d7a86d81e1aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:24.622010 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83115c11-6ada-479a-8a74-d7a86d81e1aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:24.630492 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83115c11-6ada-479a-8a74-d7a86d81e1aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:24.631907 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83115c11-6ada-479a-8a74-d7a86d81e1aa service cinder] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:24.640502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1452/2895] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:29.606419 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31861596-2d50-427f-a6c5-7ffd11de6601 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:29.666951 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31861596-2d50-427f-a6c5-7ffd11de6601 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:29.671443 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:29.672067 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:29.672346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:29.672652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] PATH_INFO: `/v3/users/e5a11b1415eb4af6b7a2ac5cf1f882f5` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:29.673755 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a11b1415eb4af6b7a2ac5cf1f882f5)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:29.675681 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:29.719685 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a11b1415eb4af6b7a2ac5cf1f882f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:29.727707 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a11b1415eb4af6b7a2ac5cf1f882f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:29.728315 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a11b1415eb4af6b7a2ac5cf1f882f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:29.728945 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a11b1415eb4af6b7a2ac5cf1f882f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:29.733485 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:29.741384 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a11b1415eb4af6b7a2ac5cf1f882f5'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:29.759086 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1444/2896] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:21:29 2022] DELETE /identity/v3/users/e5a11b1415eb4af6b7a2ac5cf1f882f5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:29.763557 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc3e6f-b65c-4590-8aa0-4508dcd2c934 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:29.764018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc3e6f-b65c-4590-8aa0-4508dcd2c934 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:29.764137 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc3e6f-b65c-4590-8aa0-4508dcd2c934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:29.783165 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-96bc3e6f-b65c-4590-8aa0-4508dcd2c934 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:29.784361 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-96bc3e6f-b65c-4590-8aa0-4508dcd2c934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:29.809188 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:29.845078 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1453/2897] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:29.854663 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:29.856126 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:29.912489 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b53b-07cf-4ecb-a9c3-5e0a722c8407 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:29.916257 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba98fd-4859-43f8-9c82-e758ab2374fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:29.916936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba98fd-4859-43f8-9c82-e758ab2374fe service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:29.917202 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba98fd-4859-43f8-9c82-e758ab2374fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:29.917493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba98fd-4859-43f8-9c82-e758ab2374fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:29.926899 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba98fd-4859-43f8-9c82-e758ab2374fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:29.928341 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba98fd-4859-43f8-9c82-e758ab2374fe service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:29.937762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1445/2898] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:30.197036 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc3e6f-b65c-4590-8aa0-4508dcd2c934 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:30.198471 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-96bc3e6f-b65c-4590-8aa0-4508dcd2c934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:30.213284 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc3e6f-b65c-4590-8aa0-4508dcd2c934 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:30.218189 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:30.218848 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.219126 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.219398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] PATH_INFO: `/v3/projects/97f491465ff34361b7bcaeabf12e29b9` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.220610 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f491465ff34361b7bcaeabf12e29b9)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:30.222482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:30.267257 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f491465ff34361b7bcaeabf12e29b9', 'request_id': 'req-95e5fdd1-b771-4eee-bcff-5a61f72de40f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:30.274539 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f491465ff34361b7bcaeabf12e29b9', 'request_id': 'req-95e5fdd1-b771-4eee-bcff-5a61f72de40f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:30.280909 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f491465ff34361b7bcaeabf12e29b9', 'request_id': 'req-95e5fdd1-b771-4eee-bcff-5a61f72de40f'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:30.291018 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] The token cache is being invalidate because project 97f491465ff34361b7bcaeabf12e29b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81514) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:21:30.291306 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:30.291933 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-95e5fdd1-b771-4eee-bcff-5a61f72de40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:21:30.293448 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1454/2899] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:21:30 2022] DELETE /identity/v3/projects/97f491465ff34361b7bcaeabf12e29b9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:30.300147 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97be0f-81fb-4204-89ee-236b6e5746c9 None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.300969 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97be0f-81fb-4204-89ee-236b6e5746c9 None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.301252 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97be0f-81fb-4204-89ee-236b6e5746c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.320787 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-1d97be0f-81fb-4204-89ee-236b6e5746c9 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:30.321981 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1d97be0f-81fb-4204-89ee-236b6e5746c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:30.379900 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1446/2900] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:30.387349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d524fa-4755-46f2-810e-b11bcb62e815 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.387757 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d524fa-4755-46f2-810e-b11bcb62e815 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.388069 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d524fa-4755-46f2-810e-b11bcb62e815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.407519 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-d0d524fa-4755-46f2-810e-b11bcb62e815 None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:30.408746 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-d0d524fa-4755-46f2-810e-b11bcb62e815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:30.417162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1455/2901] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:30.421077 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97be0f-81fb-4204-89ee-236b6e5746c9 None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:30.430542 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97be0f-81fb-4204-89ee-236b6e5746c9 None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:30.435010 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b5a74-2893-43f7-9f7e-c73835c34ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:30.435603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b5a74-2893-43f7-9f7e-c73835c34ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.435883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b5a74-2893-43f7-9f7e-c73835c34ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.436158 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b5a74-2893-43f7-9f7e-c73835c34ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.436827 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b5a74-2893-43f7-9f7e-c73835c34ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 17:21:30.437133 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b5a74-2893-43f7-9f7e-c73835c34ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:30.438719 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b5a74-2893-43f7-9f7e-c73835c34ad3 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:30.450211 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1447/2902] 10.222.0.81 () {58 vars in 1153 bytes} [Thu Aug 18 17:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 17:21:30.454230 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d524fa-4755-46f2-810e-b11bcb62e815 None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:30.463831 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d524fa-4755-46f2-810e-b11bcb62e815 None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:30.468728 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816c6c2-b4c2-4538-a767-dcf9467f12e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:30.469321 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816c6c2-b4c2-4538-a767-dcf9467f12e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.469602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816c6c2-b4c2-4538-a767-dcf9467f12e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.469877 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816c6c2-b4c2-4538-a767-dcf9467f12e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.470496 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816c6c2-b4c2-4538-a767-dcf9467f12e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:30.472365 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816c6c2-b4c2-4538-a767-dcf9467f12e5 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:30.498864 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1456/2903] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:21:30 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:30.502943 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b5a74-2893-43f7-9f7e-c73835c34ad3 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:30.513297 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b5a74-2893-43f7-9f7e-c73835c34ad3 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:30.568018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665013d-4fe0-4a67-a7ce-30ec5335eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:30.568657 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665013d-4fe0-4a67-a7ce-30ec5335eb72 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.568941 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665013d-4fe0-4a67-a7ce-30ec5335eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.569224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665013d-4fe0-4a67-a7ce-30ec5335eb72 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.569846 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665013d-4fe0-4a67-a7ce-30ec5335eb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:30.571750 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665013d-4fe0-4a67-a7ce-30ec5335eb72 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:30.582873 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:30.594364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1448/2904] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:21:30 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:30.598518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816c6c2-b4c2-4538-a767-dcf9467f12e5 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:30.608744 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816c6c2-b4c2-4538-a767-dcf9467f12e5 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:30.613277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0491a61-b371-4364-a371-4a60754500d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:30.613869 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0491a61-b371-4364-a371-4a60754500d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.614146 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0491a61-b371-4364-a371-4a60754500d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.614418 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0491a61-b371-4364-a371-4a60754500d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.615055 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0491a61-b371-4364-a371-4a60754500d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:30.616658 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0491a61-b371-4364-a371-4a60754500d1 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:30.626265 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1457/2905] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:30.630545 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665013d-4fe0-4a67-a7ce-30ec5335eb72 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:30.640804 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665013d-4fe0-4a67-a7ce-30ec5335eb72 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:30.645975 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627509e-c0a3-49e5-b156-9f7dc6ba5bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:30.646570 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627509e-c0a3-49e5-b156-9f7dc6ba5bdf admin admin] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.646850 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627509e-c0a3-49e5-b156-9f7dc6ba5bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.647123 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627509e-c0a3-49e5-b156-9f7dc6ba5bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.647762 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627509e-c0a3-49e5-b156-9f7dc6ba5bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:30.649365 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627509e-c0a3-49e5-b156-9f7dc6ba5bdf admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:30.660944 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1449/2906] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:30.664998 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0491a61-b371-4364-a371-4a60754500d1 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:30.674973 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0491a61-b371-4364-a371-4a60754500d1 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:30.679536 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691e7ba-9bd0-41e7-b882-0937585b3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:30.680183 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691e7ba-9bd0-41e7-b882-0937585b3abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.680483 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691e7ba-9bd0-41e7-b882-0937585b3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.680785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691e7ba-9bd0-41e7-b882-0937585b3abb admin admin] PATH_INFO: `/v3/projects/2f50bf867cb14316b2723f65e11565c4/users/ce5ded099d2f45f1a0b21b0aebcc166d/roles/6bf2c10dc09a4e9087fd12312566376f` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.695616 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691e7ba-9bd0-41e7-b882-0937585b3abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f50bf867cb14316b2723f65e11565c4, user_id=ce5ded099d2f45f1a0b21b0aebcc166d, role_id=6bf2c10dc09a4e9087fd12312566376f)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:30.698282 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691e7ba-9bd0-41e7-b882-0937585b3abb admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:30.711443 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1458/2907] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:30 2022] PUT /identity/v3/projects/2f50bf867cb14316b2723f65e11565c4/users/ce5ded099d2f45f1a0b21b0aebcc166d/roles/6bf2c10dc09a4e9087fd12312566376f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:30.716556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd857fb-4137-4fd0-9f02-46822c16804d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.716936 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd857fb-4137-4fd0-9f02-46822c16804d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.717207 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd857fb-4137-4fd0-9f02-46822c16804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.735863 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-2cd857fb-4137-4fd0-9f02-46822c16804d None None] MFA Rules not processed for user `ea0bb7d073ca4a9588a262eed95c091c`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:30.737102 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-2cd857fb-4137-4fd0-9f02-46822c16804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:30.794876 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1450/2908] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 17:21:30.804434 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691e7ba-9bd0-41e7-b882-0937585b3abb admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:30.806147 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-a691e7ba-9bd0-41e7-b882-0937585b3abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:30.864890 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691e7ba-9bd0-41e7-b882-0937585b3abb admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:30.870285 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab84be-2dc1-40f8-9dda-df68556a2d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:30.870899 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab84be-2dc1-40f8-9dda-df68556a2d81 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:30.871192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab84be-2dc1-40f8-9dda-df68556a2d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:30.871470 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab84be-2dc1-40f8-9dda-df68556a2d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:30.877348 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:30.882433 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab84be-2dc1-40f8-9dda-df68556a2d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:30.884134 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab84be-2dc1-40f8-9dda-df68556a2d81 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:30.894435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1459/2909] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:34.866692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182abe1-559b-4c6b-9388-2714c48d027d None None] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:34.867236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182abe1-559b-4c6b-9388-2714c48d027d None None] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:34.867236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182abe1-559b-4c6b-9388-2714c48d027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:34.897290 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.auth.core [None req-b182abe1-559b-4c6b-9388-2714c48d027d None None] MFA Rules not processed for user `ce5ded099d2f45f1a0b21b0aebcc166d`. Rule list: `[]` (Enabled: `True`). {{(pid=81515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:34.898728 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b182abe1-559b-4c6b-9388-2714c48d027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:34.968169 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1451/2910] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:34.968914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab84be-2dc1-40f8-9dda-df68556a2d81 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:34.978787 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab84be-2dc1-40f8-9dda-df68556a2d81 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:34.984837 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259ac3b-6a8f-4076-8b1c-6549d97308e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:34.985482 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259ac3b-6a8f-4076-8b1c-6549d97308e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:34.985763 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259ac3b-6a8f-4076-8b1c-6549d97308e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:34.986039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259ac3b-6a8f-4076-8b1c-6549d97308e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:34.986667 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259ac3b-6a8f-4076-8b1c-6549d97308e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:34.989094 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259ac3b-6a8f-4076-8b1c-6549d97308e4 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:35.016214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1460/2911] 10.222.0.81 () {60 vars in 1153 bytes} [Thu Aug 18 17:21:34 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 17:21:35.020278 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182abe1-559b-4c6b-9388-2714c48d027d None None] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:35.030992 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182abe1-559b-4c6b-9388-2714c48d027d None None] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:35.087405 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b5c8-b487-4c13-8c52-2a6c94fae6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:35.088011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b5c8-b487-4c13-8c52-2a6c94fae6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:35.088292 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b5c8-b487-4c13-8c52-2a6c94fae6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:35.088603 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946b5c8-b487-4c13-8c52-2a6c94fae6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:35.089236 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946b5c8-b487-4c13-8c52-2a6c94fae6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:35.091409 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946b5c8-b487-4c13-8c52-2a6c94fae6b2 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:35.112364 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1452/2912] 10.222.0.81 () {60 vars in 1144 bytes} [Thu Aug 18 17:21:35 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 17:21:35.116850 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259ac3b-6a8f-4076-8b1c-6549d97308e4 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:35.127028 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259ac3b-6a8f-4076-8b1c-6549d97308e4 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:35.131544 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daa478-ae7a-423c-92eb-7ec8b40096bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:35.132140 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daa478-ae7a-423c-92eb-7ec8b40096bc admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:35.132424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daa478-ae7a-423c-92eb-7ec8b40096bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:35.132736 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daa478-ae7a-423c-92eb-7ec8b40096bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:35.133378 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daa478-ae7a-423c-92eb-7ec8b40096bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:35.135039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daa478-ae7a-423c-92eb-7ec8b40096bc admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:35.145846 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1461/2913] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:35.150063 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b5c8-b487-4c13-8c52-2a6c94fae6b2 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:35.156803 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:35.161839 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946b5c8-b487-4c13-8c52-2a6c94fae6b2 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:35.167933 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192acc4b-6eeb-48dc-baea-17eaf1bc095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:35.168643 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192acc4b-6eeb-48dc-baea-17eaf1bc095d admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:35.168930 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192acc4b-6eeb-48dc-baea-17eaf1bc095d admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:35.169213 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192acc4b-6eeb-48dc-baea-17eaf1bc095d admin admin] PATH_INFO: `/v3/projects/b342ca74bd684928a8f1cc9736a09e4e/users/f4d7e0fb025f486fa2e1e7fba81e8a0a/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:35.185680 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192acc4b-6eeb-48dc-baea-17eaf1bc095d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b342ca74bd684928a8f1cc9736a09e4e, user_id=f4d7e0fb025f486fa2e1e7fba81e8a0a, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:35.188371 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192acc4b-6eeb-48dc-baea-17eaf1bc095d admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:35.201247 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1453/2914] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:35 2022] PUT /identity/v3/projects/b342ca74bd684928a8f1cc9736a09e4e/users/f4d7e0fb025f486fa2e1e7fba81e8a0a/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:35.205192 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daa478-ae7a-423c-92eb-7ec8b40096bc admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:35.215653 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daa478-ae7a-423c-92eb-7ec8b40096bc admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:35.272352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb299fe4-d89c-4bfd-ad7d-336cb25a0a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:35.272994 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb299fe4-d89c-4bfd-ad7d-336cb25a0a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:35.273277 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb299fe4-d89c-4bfd-ad7d-336cb25a0a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:35.273554 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb299fe4-d89c-4bfd-ad7d-336cb25a0a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:35.274193 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb299fe4-d89c-4bfd-ad7d-336cb25a0a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:35.275776 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb299fe4-d89c-4bfd-ad7d-336cb25a0a59 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:35.285959 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1462/2915] 10.222.0.81 () {58 vars in 1122 bytes} [Thu Aug 18 17:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 17:21:35.290125 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192acc4b-6eeb-48dc-baea-17eaf1bc095d admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:35.300320 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192acc4b-6eeb-48dc-baea-17eaf1bc095d admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:35.305496 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc04b0-ece7-4170-93df-e20ce1e872b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:35.306142 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc04b0-ece7-4170-93df-e20ce1e872b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:35.306420 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc04b0-ece7-4170-93df-e20ce1e872b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:35.306831 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc04b0-ece7-4170-93df-e20ce1e872b7 admin admin] PATH_INFO: `/v3/projects/b342ca74bd684928a8f1cc9736a09e4e/users/f4d7e0fb025f486fa2e1e7fba81e8a0a/roles/56228137a4444ef9b7e688d04abd00fd` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:35.308765 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc04b0-ece7-4170-93df-e20ce1e872b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b342ca74bd684928a8f1cc9736a09e4e, user_id=f4d7e0fb025f486fa2e1e7fba81e8a0a, role_id=56228137a4444ef9b7e688d04abd00fd)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:35.311346 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc04b0-ece7-4170-93df-e20ce1e872b7 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:35.321411 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1454/2916] 10.222.0.81 () {60 vars in 1483 bytes} [Thu Aug 18 17:21:35 2022] PUT /identity/v3/projects/b342ca74bd684928a8f1cc9736a09e4e/users/f4d7e0fb025f486fa2e1e7fba81e8a0a/roles/56228137a4444ef9b7e688d04abd00fd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:21:39.678972 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07919e28-591b-4731-8047-9bc76f558a80 None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:39.688528 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07919e28-591b-4731-8047-9bc76f558a80 None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:39.689212 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07919e28-591b-4731-8047-9bc76f558a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:39.737755 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-07919e28-591b-4731-8047-9bc76f558a80 None None] MFA Rules not processed for user `f4d7e0fb025f486fa2e1e7fba81e8a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:39.743752 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-07919e28-591b-4731-8047-9bc76f558a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:39.832590 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1463/2917] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:39.851011 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc04b0-ece7-4170-93df-e20ce1e872b7 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:39.853321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-cedc04b0-ece7-4170-93df-e20ce1e872b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:39.940657 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc04b0-ece7-4170-93df-e20ce1e872b7 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:39.947246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a20318-20ba-418a-80fd-a1d43521fcae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:39.948176 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a20318-20ba-418a-80fd-a1d43521fcae service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:39.948702 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a20318-20ba-418a-80fd-a1d43521fcae service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:39.949054 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a20318-20ba-418a-80fd-a1d43521fcae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:40.019016 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a20318-20ba-418a-80fd-a1d43521fcae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:40.021412 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a20318-20ba-418a-80fd-a1d43521fcae service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:40.031521 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1455/2918] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:21:40.986753 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1599-8a18-4308-9ae9-1f2481663d5a None None] REQUEST_METHOD: `POST` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:40.987296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1599-8a18-4308-9ae9-1f2481663d5a None None] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:40.987296 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1599-8a18-4308-9ae9-1f2481663d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:41.006938 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.auth.core [None req-6c3d1599-8a18-4308-9ae9-1f2481663d5a None None] MFA Rules not processed for user `ce5ded099d2f45f1a0b21b0aebcc166d`. Rule list: `[]` (Enabled: `True`). {{(pid=81514) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 17:21:41.008155 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6c3d1599-8a18-4308-9ae9-1f2481663d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:41.015080 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1464/2919] 10.222.0.81 () {58 vars in 958 bytes} [Thu Aug 18 17:21:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 17:21:50.026866 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=69,keystone:INSERT=2 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:51.001602 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:21:57.984025 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a20318-20ba-418a-80fd-a1d43521fcae service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:21:57.985493 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-94a20318-20ba-418a-80fd-a1d43521fcae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:58.055249 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a20318-20ba-418a-80fd-a1d43521fcae service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:21:58.060282 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b569e-b0d5-4f36-8f1e-2b1a46e2c93f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:21:58.060954 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b569e-b0d5-4f36-8f1e-2b1a46e2c93f service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:21:58.061237 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b569e-b0d5-4f36-8f1e-2b1a46e2c93f service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:21:58.061514 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b569e-b0d5-4f36-8f1e-2b1a46e2c93f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:21:58.063228 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bd1b569e-b0d5-4f36-8f1e-2b1a46e2c93f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:21:58.075137 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b569e-b0d5-4f36-8f1e-2b1a46e2c93f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:21:58.076732 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b569e-b0d5-4f36-8f1e-2b1a46e2c93f service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:21:58.086550 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1456/2920] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:21:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:22:08.082332 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=32 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:08.311990 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d1599-8a18-4308-9ae9-1f2481663d5a None None] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:22:08.313726 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6c3d1599-8a18-4308-9ae9-1f2481663d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:22:08.413914 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d1599-8a18-4308-9ae9-1f2481663d5a None None] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:22:08.420171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11907458-2107-40ea-b833-64d58b5526b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:22:08.420823 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11907458-2107-40ea-b833-64d58b5526b7 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:22:08.421109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11907458-2107-40ea-b833-64d58b5526b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:22:08.421387 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11907458-2107-40ea-b833-64d58b5526b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:22:08.423128 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-11907458-2107-40ea-b833-64d58b5526b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:22:08.436729 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11907458-2107-40ea-b833-64d58b5526b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:22:08.438323 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11907458-2107-40ea-b833-64d58b5526b7 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:22:08.448943 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1465/2921] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:22:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 17:22:11.148117 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b569e-b0d5-4f36-8f1e-2b1a46e2c93f service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:22:11.149587 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-bd1b569e-b0d5-4f36-8f1e-2b1a46e2c93f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:22:11.233652 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b569e-b0d5-4f36-8f1e-2b1a46e2c93f service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:22:11.237214 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e5701-6fe6-4cf4-814f-bc4d0ba3223c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:22:11.237823 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e5701-6fe6-4cf4-814f-bc4d0ba3223c service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:22:11.238100 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e5701-6fe6-4cf4-814f-bc4d0ba3223c service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:22:11.238375 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e5701-6fe6-4cf4-814f-bc4d0ba3223c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:22:11.247050 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e5701-6fe6-4cf4-814f-bc4d0ba3223c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:22:11.248414 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e5701-6fe6-4cf4-814f-bc4d0ba3223c service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:22:11.258224 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1457/2922] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:22:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:22:12.768502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11907458-2107-40ea-b833-64d58b5526b7 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:22:12.780001 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11907458-2107-40ea-b833-64d58b5526b7 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:22:12.785572 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16aef8-4926-4602-88ca-c26d52774e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:22:12.786238 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16aef8-4926-4602-88ca-c26d52774e91 service nova] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:22:12.787116 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16aef8-4926-4602-88ca-c26d52774e91 service nova] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:22:12.787454 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16aef8-4926-4602-88ca-c26d52774e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:22:12.789274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-2f16aef8-4926-4602-88ca-c26d52774e91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:22:12.801413 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16aef8-4926-4602-88ca-c26d52774e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:22:12.803523 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16aef8-4926-4602-88ca-c26d52774e91 service nova] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:22:12.814098 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1466/2923] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:22:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:22:21.253556 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=39 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:22.809583 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=46 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:22:24.944018 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e5701-6fe6-4cf4-814f-bc4d0ba3223c service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:22:24.965303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e5701-6fe6-4cf4-814f-bc4d0ba3223c service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:22:24.970507 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682863b-cc62-4767-af46-f12504c4eb90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:22:24.971108 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682863b-cc62-4767-af46-f12504c4eb90 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:22:24.971391 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682863b-cc62-4767-af46-f12504c4eb90 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:22:24.971670 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682863b-cc62-4767-af46-f12504c4eb90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:22:24.973360 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6682863b-cc62-4767-af46-f12504c4eb90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:22:24.997773 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682863b-cc62-4767-af46-f12504c4eb90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:22:24.999311 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682863b-cc62-4767-af46-f12504c4eb90 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:22:25.009283 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1458/2924] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:22:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:22:35.005061 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=15 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:24:52.108300 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16aef8-4926-4602-88ca-c26d52774e91 service nova] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:24:52.127035 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16aef8-4926-4602-88ca-c26d52774e91 service nova] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:24:52.130645 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb31b88-3061-450f-a1f6-2647c84b77db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:24:52.131232 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31b88-3061-450f-a1f6-2647c84b77db service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:24:52.131598 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31b88-3061-450f-a1f6-2647c84b77db service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:24:52.131879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb31b88-3061-450f-a1f6-2647c84b77db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:24:52.133604 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-6cb31b88-3061-450f-a1f6-2647c84b77db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:24:52.155065 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb31b88-3061-450f-a1f6-2647c84b77db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:24:52.156549 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb31b88-3061-450f-a1f6-2647c84b77db service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:24:52.165056 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1467/2925] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:24:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:24:52.279246 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682863b-cc62-4767-af46-f12504c4eb90 service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:24:52.289104 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682863b-cc62-4767-af46-f12504c4eb90 service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:24:52.292672 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722fc06-b973-417a-a113-06eaeb4f1306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:24:52.293272 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722fc06-b973-417a-a113-06eaeb4f1306 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:24:52.293553 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722fc06-b973-417a-a113-06eaeb4f1306 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:24:52.293825 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722fc06-b973-417a-a113-06eaeb4f1306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:24:52.295536 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-1722fc06-b973-417a-a113-06eaeb4f1306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:24:52.306189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722fc06-b973-417a-a113-06eaeb4f1306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:24:52.307703 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722fc06-b973-417a-a113-06eaeb4f1306 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:24:52.315949 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1459/2926] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:24:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:24:52.686215 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb31b88-3061-450f-a1f6-2647c84b77db service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:24:52.694928 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb31b88-3061-450f-a1f6-2647c84b77db service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:24:52.698541 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8edd-771c-41bf-85b1-db9b5ed35300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:24:52.699144 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8edd-771c-41bf-85b1-db9b5ed35300 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:24:52.699421 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8edd-771c-41bf-85b1-db9b5ed35300 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:24:52.699693 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8edd-771c-41bf-85b1-db9b5ed35300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:24:52.701518 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-c40c8edd-771c-41bf-85b1-db9b5ed35300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:24:52.715724 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c8edd-771c-41bf-85b1-db9b5ed35300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:24:52.717162 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c8edd-771c-41bf-85b1-db9b5ed35300 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:24:52.728805 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1468/2927] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:24:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:25:02.312334 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:25:02.724429 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=21 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:25:22.658697 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722fc06-b973-417a-a113-06eaeb4f1306 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:25:22.668303 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722fc06-b973-417a-a113-06eaeb4f1306 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:25:22.671968 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94c79e-ee02-444c-8594-541f2c3e6c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:25:22.672611 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94c79e-ee02-444c-8594-541f2c3e6c79 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:25:22.672915 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94c79e-ee02-444c-8594-541f2c3e6c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:25:22.673188 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94c79e-ee02-444c-8594-541f2c3e6c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:25:22.674916 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-ae94c79e-ee02-444c-8594-541f2c3e6c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:25:22.684227 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94c79e-ee02-444c-8594-541f2c3e6c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:25:22.685662 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94c79e-ee02-444c-8594-541f2c3e6c79 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:25:22.693586 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1460/2928] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:25:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:25:32.689978 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=6 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:43.369704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8edd-771c-41bf-85b1-db9b5ed35300 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:26:43.378462 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8edd-771c-41bf-85b1-db9b5ed35300 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:26:43.382076 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c5705-9817-45da-8ba9-0b17558bbded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:26:43.382665 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c5705-9817-45da-8ba9-0b17558bbded service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:26:43.382947 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c5705-9817-45da-8ba9-0b17558bbded service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:26:43.383219 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c5705-9817-45da-8ba9-0b17558bbded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:26:43.391274 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c5705-9817-45da-8ba9-0b17558bbded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:26:43.392700 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c5705-9817-45da-8ba9-0b17558bbded service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:26:43.401839 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1469/2929] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:26:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:26:44.428203 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94c79e-ee02-444c-8594-541f2c3e6c79 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:26:44.437913 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94c79e-ee02-444c-8594-541f2c3e6c79 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:26:44.441868 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838a1eb-9620-49ff-9ab0-0e16abb075c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:26:44.442731 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838a1eb-9620-49ff-9ab0-0e16abb075c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:26:44.443003 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838a1eb-9620-49ff-9ab0-0e16abb075c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:26:44.443620 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838a1eb-9620-49ff-9ab0-0e16abb075c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:26:44.446248 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-6838a1eb-9620-49ff-9ab0-0e16abb075c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:26:44.462294 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838a1eb-9620-49ff-9ab0-0e16abb075c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:26:44.463996 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838a1eb-9620-49ff-9ab0-0e16abb075c5 service neutron] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:26:44.476200 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1461/2930] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:26:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:26:45.655446 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c5705-9817-45da-8ba9-0b17558bbded service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:26:45.664738 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c5705-9817-45da-8ba9-0b17558bbded service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:26:45.668646 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9e11a-dcfe-4969-9d08-c27ac32078e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:26:45.669311 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9e11a-dcfe-4969-9d08-c27ac32078e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:26:45.669594 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9e11a-dcfe-4969-9d08-c27ac32078e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:26:45.669936 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9e11a-dcfe-4969-9d08-c27ac32078e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:26:45.671732 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-b6b9e11a-dcfe-4969-9d08-c27ac32078e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:26:45.686043 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9e11a-dcfe-4969-9d08-c27ac32078e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:26:45.687473 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9e11a-dcfe-4969-9d08-c27ac32078e8 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:26:45.699097 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1470/2931] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:26:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:26:46.485918 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838a1eb-9620-49ff-9ab0-0e16abb075c5 service neutron] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:26:46.499634 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838a1eb-9620-49ff-9ab0-0e16abb075c5 service neutron] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:26:46.505927 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af663-07ff-4f8a-aee7-ddb537d7498f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c425b390c8dc4d799270fdd095be78b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:26:46.506594 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af663-07ff-4f8a-aee7-ddb537d7498f service nova] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:26:46.506875 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af663-07ff-4f8a-aee7-ddb537d7498f service nova] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:26:46.507708 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af663-07ff-4f8a-aee7-ddb537d7498f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:26:46.509847 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-842af663-07ff-4f8a-aee7-ddb537d7498f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:26:46.524064 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842af663-07ff-4f8a-aee7-ddb537d7498f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:26:46.525801 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842af663-07ff-4f8a-aee7-ddb537d7498f service nova] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:26:46.537378 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1462/2932] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:26:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:26:48.186205 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9e11a-dcfe-4969-9d08-c27ac32078e8 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:26:48.195502 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9e11a-dcfe-4969-9d08-c27ac32078e8 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:26:48.199214 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03b821-1252-496b-a787-34e78a6a3101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1fde904acd460899d8c736f5762056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:26:48.200312 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b821-1252-496b-a787-34e78a6a3101 service neutron] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:26:48.200640 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b821-1252-496b-a787-34e78a6a3101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:26:48.200918 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b821-1252-496b-a787-34e78a6a3101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:26:48.270662 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03b821-1252-496b-a787-34e78a6a3101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:26:48.272014 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03b821-1252-496b-a787-34e78a6a3101 service neutron] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:26:48.290903 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1471/2933] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:26:51.320273 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af663-07ff-4f8a-aee7-ddb537d7498f service nova] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:26:51.321858 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-842af663-07ff-4f8a-aee7-ddb537d7498f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:26:51.335793 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af663-07ff-4f8a-aee7-ddb537d7498f service nova] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:26:51.341036 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641ff79-70e0-4757-a63c-ffcc870295b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:26:51.341638 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ff79-70e0-4757-a63c-ffcc870295b8 service placement] REQUEST_METHOD: `GET` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:26:51.341920 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ff79-70e0-4757-a63c-ffcc870295b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:26:51.342199 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ff79-70e0-4757-a63c-ffcc870295b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:26:51.343883 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-e641ff79-70e0-4757-a63c-ffcc870295b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:26:51.356910 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641ff79-70e0-4757-a63c-ffcc870295b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:26:51.358630 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641ff79-70e0-4757-a63c-ffcc870295b8 service placement] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:26:51.374909 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1463/2934] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:26:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:26:54.476349 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03b821-1252-496b-a787-34e78a6a3101 service neutron] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:26:54.486578 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03b821-1252-496b-a787-34e78a6a3101 service neutron] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:26:54.491772 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:26:54.492398 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:26:54.492714 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:26:54.492995 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] PATH_INFO: `/v3/users/ce5ded099d2f45f1a0b21b0aebcc166d` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:26:54.494111 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5ded099d2f45f1a0b21b0aebcc166d)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:26:54.496013 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:26:54.545676 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5ded099d2f45f1a0b21b0aebcc166d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:54.546352 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5ded099d2f45f1a0b21b0aebcc166d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:54.558573 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5ded099d2f45f1a0b21b0aebcc166d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:54.565466 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5ded099d2f45f1a0b21b0aebcc166d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:54.566171 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5ded099d2f45f1a0b21b0aebcc166d'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:54.580332 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1472/2935] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:26:54 2022] DELETE /identity/v3/users/ce5ded099d2f45f1a0b21b0aebcc166d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:26:54.764983 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641ff79-70e0-4757-a63c-ffcc870295b8 service placement] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:26:54.781197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641ff79-70e0-4757-a63c-ffcc870295b8 service placement] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:26:54.837862 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:26:54.838502 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:26:54.838789 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:26:54.839070 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] PATH_INFO: `/v3/projects/2f50bf867cb14316b2723f65e11565c4` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:26:54.840189 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f50bf867cb14316b2723f65e11565c4)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:26:54.842162 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:26:54.887547 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f50bf867cb14316b2723f65e11565c4', 'request_id': 'req-b62506d0-3476-455e-95a1-06627749fc24'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:54.893540 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f50bf867cb14316b2723f65e11565c4', 'request_id': 'req-b62506d0-3476-455e-95a1-06627749fc24'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:54.900772 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f50bf867cb14316b2723f65e11565c4', 'request_id': 'req-b62506d0-3476-455e-95a1-06627749fc24'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:54.923848 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] The token cache is being invalidate because project 2f50bf867cb14316b2723f65e11565c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:26:54.924134 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:54.924766 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:54.926794 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1464/2936] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:26:54 2022] DELETE /identity/v3/projects/2f50bf867cb14316b2723f65e11565c4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:26:54.930879 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:26:54.932275 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:26:54.945615 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2019d7-1442-4eaf-88bc-d6f840e16f8b admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:26:54.963770 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:55.003264 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:26:55.004441 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:26:55.004762 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:26:55.005039 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] PATH_INFO: `/v3/users/f4d7e0fb025f486fa2e1e7fba81e8a0a` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:26:55.006173 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d7e0fb025f486fa2e1e7fba81e8a0a)` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:26:55.008085 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:26:55.052135 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d7e0fb025f486fa2e1e7fba81e8a0a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:55.052780 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d7e0fb025f486fa2e1e7fba81e8a0a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:55.064481 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d7e0fb025f486fa2e1e7fba81e8a0a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:55.071157 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d7e0fb025f486fa2e1e7fba81e8a0a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:55.071785 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.notifications [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d7e0fb025f486fa2e1e7fba81e8a0a'} {{(pid=81514) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:55.083985 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1473/2937] 10.222.0.81 () {58 vars in 1224 bytes} [Thu Aug 18 17:26:54 2022] DELETE /identity/v3/users/f4d7e0fb025f486fa2e1e7fba81e8a0a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:26:55.257321 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] Authenticating user token {{(pid=81515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:26:55.258888 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.fernet_utils [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:26:55.276946 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62506d0-3476-455e-95a1-06627749fc24 admin admin] Validating token access rules against request {{(pid=81515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:26:55.315490 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:26:55.335116 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb7d073ca4a9588a262eed95c091c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45c851fba36042bc85eb05b39752f169', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:26:55.335745 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:26:55.336023 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] SCRIPT_NAME: `/identity` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:26:55.336295 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] PATH_INFO: `/v3/projects/b342ca74bd684928a8f1cc9736a09e4e` {{(pid=81515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:26:55.337692 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b342ca74bd684928a8f1cc9736a09e4e)` {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:26:55.339574 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] RBAC: Authorization granted {{(pid=81515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:26:55.386089 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b342ca74bd684928a8f1cc9736a09e4e', 'request_id': 'req-bb24a507-a25f-4afb-9e8d-3795b773057b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:55.392197 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b342ca74bd684928a8f1cc9736a09e4e', 'request_id': 'req-bb24a507-a25f-4afb-9e8d-3795b773057b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:55.400146 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b342ca74bd684928a8f1cc9736a09e4e', 'request_id': 'req-bb24a507-a25f-4afb-9e8d-3795b773057b'} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:55.410742 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] The token cache is being invalidate because project b342ca74bd684928a8f1cc9736a09e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 17:26:55.411031 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:55.411646 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG keystone.notifications [None req-bb24a507-a25f-4afb-9e8d-3795b773057b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 17:26:55.413259 dv-cinder-853678-2-smb devstack@keystone.service[81515]: [pid: 81515|app: 0|req: 1465/2938] 10.222.0.81 () {58 vars in 1233 bytes} [Thu Aug 18 17:26:55 2022] DELETE /identity/v3/projects/b342ca74bd684928a8f1cc9736a09e4e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 17:27:05.080724 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:27:05.407308 dv-cinder-853678-2-smb devstack@keystone.service[81515]: DEBUG dbcounter [-] [81515] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:27:27.901278 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] Authenticating user token {{(pid=81514) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 17:27:27.902691 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:27:27.973141 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ed011-5528-4a5c-9211-bf8087312ab8 admin admin] Validating token access rules against request {{(pid=81514) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 17:27:28.031500 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da23091-eefa-4012-942b-4e3c778dbd35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cc1ad7e47454b5d9d2ef2190414010c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7e1ec5606b47079057c3aa466c8537', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81514) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 17:27:28.032109 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23091-eefa-4012-942b-4e3c778dbd35 service placement] REQUEST_METHOD: `GET` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 17:27:28.032390 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23091-eefa-4012-942b-4e3c778dbd35 service placement] SCRIPT_NAME: `/identity` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 17:27:28.032704 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23091-eefa-4012-942b-4e3c778dbd35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81514) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 17:27:28.034424 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.fernet_utils [None req-7da23091-eefa-4012-942b-4e3c778dbd35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81514) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 17:27:28.045435 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da23091-eefa-4012-942b-4e3c778dbd35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 17:27:28.047009 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da23091-eefa-4012-942b-4e3c778dbd35 service placement] RBAC: Authorization granted {{(pid=81514) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 17:27:28.056856 dv-cinder-853678-2-smb devstack@keystone.service[81514]: [pid: 81514|app: 0|req: 1474/2939] 10.222.0.81 () {60 vars in 1365 bytes} [Thu Aug 18 17:27:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 17:27:38.052727 dv-cinder-853678-2-smb devstack@keystone.service[81514]: DEBUG dbcounter [-] [81514] Writing DB stats keystone:SELECT=58 {{(pid=81514) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}